-- Logs begin at Fri 2022-08-19 14:36:36 UTC, end at Fri 2022-08-19 15:41:00 UTC. -- Aug 19 15:14:18.980823 dv-cinder-835384-20-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 19 15:14:18.989919 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 19 15:14:18.991678 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 15:14:18 2022] *** Aug 19 15:14:18.991678 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 15:14:18.991678 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 15:14:18.991678 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: nodename: dv-cinder-835384-20-iscsi Aug 19 15:14:18.991678 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: machine: x86_64 Aug 19 15:14:18.991678 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: clock source: unix Aug 19 15:14:18.991678 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: pcre jit disabled Aug 19 15:14:18.991678 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: detected number of CPU cores: 4 Aug 19 15:14:18.991678 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: current working directory: / Aug 19 15:14:18.991678 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: detected binary path: /usr/bin/uwsgi-core Aug 19 15:14:18.992365 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: your processes number limit is 47680 Aug 19 15:14:18.992365 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: your memory page size is 4096 bytes Aug 19 15:14:18.992365 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: detected max file descriptor number: 2048 Aug 19 15:14:18.992365 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: lock engine: pthread robust mutexes Aug 19 15:14:18.992365 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: thunder lock: enabled Aug 19 15:14:18.992365 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 19 15:14:18.992365 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 15:14:19.031518 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: Python main interpreter initialized at 0x55ae44d999c0 Aug 19 15:14:19.031518 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: python threads support enabled Aug 19 15:14:19.031518 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: your server socket listen backlog is limited to 100 connections Aug 19 15:14:19.031518 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: your mercy for graceful operations on workers is 90 seconds Aug 19 15:14:19.031911 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 15:14:19.031911 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: *** Operational MODE: preforking *** Aug 19 15:14:19.032187 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: *** uWSGI is running in multiple interpreter mode *** Aug 19 15:14:19.032187 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: spawned uWSGI master process (pid: 105501) Aug 19 15:14:19.032382 dv-cinder-835384-20-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 19 15:14:19.034444 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: spawned uWSGI worker 1 (pid: 105502, cores: 1) Aug 19 15:14:19.034444 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: spawned uWSGI worker 2 (pid: 105503, cores: 1) Aug 19 15:14:19.034444 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 15:14:19.694709 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 19 15:14:19.696821 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 19 15:14:20.785380 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 15:14:20.785380 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: from cryptography.utils import int_from_bytes Aug 19 15:14:20.785957 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 15:14:20.785957 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: from cryptography.utils import int_from_bytes Aug 19 15:14:20.787691 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 15:14:20.787691 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: from cryptography.utils import int_from_bytes Aug 19 15:14:20.788122 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 15:14:20.788122 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: from cryptography.utils import int_from_bytes Aug 19 15:14:23.276296 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 15:14:23.277495 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 15:14:23.277612 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 15:14:23.278107 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 15:14:23.278198 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 15:14:23.278276 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 15:14:23.278276 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 15:14:23.278404 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 15:14:23.278586 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.278749 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 15:14:23.278904 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.278991 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 15:14:23.279224 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.279375 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.279540 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.279705 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.279866 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.280045 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.280189 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.280344 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.280503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.280700 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.280821 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.281012 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.281146 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.281331 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.281415 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.281650 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.281744 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.281978 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.282071 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-20-iscsi {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.282239 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.282329 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.282553 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.283135 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-20-iscsi {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.283299 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.283455 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.283619 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.283761 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.283940 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.284093 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.284251 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.284374 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.284713 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.285034 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.285337 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.285834 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.286270 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.286578 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.286889 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.287225 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.287545 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.287853 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.288011 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.288171 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.288264 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.288504 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.288809 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.288933 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.289123 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.289216 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.289439 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.289523 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-20-iscsi {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.289759 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.289849 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.290100 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.290206 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.290420 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.290519 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.290732 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.290824 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.291053 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.291134 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.291364 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.291467 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.291689 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.291790 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.291999 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.292101 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.292330 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.292464 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-20-iscsi {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.292730 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.292863 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.293016 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.293289 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.293378 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.293609 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.293704 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.293922 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.294006 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.294235 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.294396 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.294538 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.294699 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.294827 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.294963 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.295129 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.295259 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.295435 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.295609 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.295738 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.295977 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.296104 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.296298 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.296471 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.296648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.296734 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.296967 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.297053 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.297214 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.297307 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.297464 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.297557 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.297779 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.297873 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.298098 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.298191 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.298406 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.298490 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.298715 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.298814 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.298985 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.299072 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.299292 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.299376 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.299607 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.299699 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.299990 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.300129 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.300454 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.300845 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.301170 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.301488 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.302003 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.302319 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.302713 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.303114 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.303374 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.303686 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.303768 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.304028 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.304112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.304347 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.304476 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.304681 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.304765 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.304999 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.305084 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.305320 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.305405 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.305628 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.305712 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.305932 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.306064 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.306226 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.306308 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.306544 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.306630 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.306878 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.306961 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.307185 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.307278 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.307437 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.307521 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.307737 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.307821 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.308043 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.308150 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.308420 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.308654 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.308782 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.308879 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.309020 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.309165 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.309328 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.309567 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.309658 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.309824 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.309909 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.310136 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.310243 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.310478 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.310569 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.310792 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.310890 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.311099 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.311190 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.311403 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.311487 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.311708 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.311800 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.312011 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.312095 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.312315 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.312436 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.312648 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.312733 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.312970 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.313053 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.313282 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.313381 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.313588 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.313674 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.313838 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.313921 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.314140 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.314243 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.314447 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.314542 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.314765 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.314855 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.315069 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.315162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.315372 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.315455 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.315677 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.315769 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.315977 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.316074 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.316283 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.316372 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.316615 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.316700 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.316917 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.317017 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.317224 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.317310 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.317520 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.317603 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.317821 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.317906 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.318127 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.318219 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.318430 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.318524 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.318731 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.318850 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.319031 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.319116 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.319334 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.319429 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.319635 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.319727 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.319935 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.320025 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.320235 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.320320 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.320561 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.320661 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.320861 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.320957 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.321169 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.321253 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.321472 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.321558 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.321777 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.321861 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.322078 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.322169 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.322380 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.322465 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.322690 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.322781 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.322996 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.323095 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.323298 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.323382 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.323610 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.323695 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.324545 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.324649 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.324885 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.325035 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.325219 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.325360 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.325540 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.325672 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.325854 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.325977 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.326169 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.326298 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.326500 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.326629 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.326809 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.326895 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.327121 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.327213 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.327432 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.327524 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.327731 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.327821 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.328027 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.328112 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.328341 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.328485 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.328688 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.328781 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.328996 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.329099 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.329302 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.329387 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.329606 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.329702 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.329921 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.330004 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:14:23.330251 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.330388 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.330571 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.330657 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.330881 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.330977 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.331216 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.331307 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.331548 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.331644 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.331855 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.331939 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.332181 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.332271 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.332515 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.332622 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.332827 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.332919 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.333136 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.333220 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.333446 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.333542 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.333756 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.333849 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.334067 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.334151 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.334383 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.334467 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.334697 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.334790 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.335009 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.335093 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.335321 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.335404 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.335631 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.335723 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.335943 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.336028 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.336251 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.336371 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.336595 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.336682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.336911 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.337007 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.337227 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.337318 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.337534 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.337622 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.337848 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.337931 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.338161 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.338245 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.338474 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.338559 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.338786 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.338872 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.339092 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.339175 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.339486 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.340111 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.340337 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.340548 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.340679 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.340787 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.340990 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.341093 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.341310 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.341408 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.341640 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.341737 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.341949 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.342054 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.342262 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.342347 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.342576 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.342683 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.342884 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.342981 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.343191 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.343286 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.343501 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.343609 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.343807 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.343911 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.344123 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.344219 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.344454 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.344565 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.344764 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.344860 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.345080 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.345176 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.345387 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.345482 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.345693 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.345789 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.346000 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.346095 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.346306 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.346421 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.346608 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.346755 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.346887 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.347015 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.347201 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.347311 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.347504 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.347590 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.347815 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.347898 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.348128 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.348215 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.348452 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.348539 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.348775 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.348874 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.349077 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.349196 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.349386 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.349479 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.349695 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.349793 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.350002 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.350087 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.350305 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.350389 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.350622 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.350717 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.350932 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.351021 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.351235 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.351321 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.351546 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.351641 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.351852 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.351936 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.352153 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.352236 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.352479 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.352568 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.352790 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.352876 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.353093 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.353184 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.353400 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.353499 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.353704 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.353787 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.354012 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.354094 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.354318 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.354405 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.354626 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.354718 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.354935 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.355049 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.355271 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.355388 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.355588 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.355725 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.355915 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.356014 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.356242 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.356334 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.356575 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.356703 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.356898 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.357078 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.357223 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.357325 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.357539 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.357625 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.357843 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.357943 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.358151 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.358237 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.358455 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.358540 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.358759 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.358860 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.359061 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.359155 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.359372 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.359509 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.359670 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.359798 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.359972 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.360102 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.360276 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.360425 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.360610 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.360755 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.360897 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.360986 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.361384 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.361527 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.361669 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.361805 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.361938 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.362070 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.362209 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.362342 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.362484 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.362617 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.362762 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.362903 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.363036 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.363340 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.363474 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.363674 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.363805 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.363994 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.364131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.364316 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.364472 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.364653 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.364794 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.364967 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.365116 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.365278 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.365418 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.365719 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.365895 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.366034 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.366203 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.366338 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.366521 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.366672 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.366809 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.366953 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.367134 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.367270 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.367441 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.367574 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.367758 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.367898 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.368062 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.368190 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.368375 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.368538 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.368696 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.368841 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.369001 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.369132 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.369334 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.369462 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.369648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.369778 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.369960 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.370093 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.370268 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.370395 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.370600 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.370824 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.371020 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.371156 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.371245 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.371324 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.371500 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.371640 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.371804 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.371938 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.372113 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.372259 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.372453 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.372543 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.372766 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.372853 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.373071 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.373162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.373378 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.373494 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.373685 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.373768 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.373988 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.374082 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.374292 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.374384 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.374591 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.374675 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.374902 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.374989 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.375212 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.375296 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.375534 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.375628 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.375842 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.375926 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.376144 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.376227 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.376471 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.376560 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.376780 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.376874 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.377089 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.377173 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.377392 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.377484 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.377695 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.377787 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.377996 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.378080 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.378301 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.378394 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.378611 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.378696 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.378919 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.379003 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.379227 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.379328 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.379531 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.379665 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.379840 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.379967 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.380149 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.380283 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.380484 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.380732 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.380960 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.381178 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.381390 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.381630 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.381827 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.381957 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.381957 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.382200 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.382337 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.382581 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.382712 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.382893 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.383035 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.383212 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.383354 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.383520 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.383650 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.383840 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.383969 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.384154 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.384292 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.384474 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.384603 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.384778 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.384921 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.385066 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.385209 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.385370 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.385653 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.385782 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.385988 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.386190 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.386911 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.387045 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.387193 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.387336 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.387470 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.387623 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.387766 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.387901 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.388035 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.388167 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.388299 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.388476 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.388621 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.388760 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.388944 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.389133 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.389254 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.389367 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.389562 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.389674 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.389872 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.389965 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.390180 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.390265 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.390489 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.390575 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.390798 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.390882 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.391122 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.391207 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.391429 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.391515 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.391730 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.391813 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.392034 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.392147 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.392334 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.392472 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.392738 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.392840 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.392972 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.393071 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.393276 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.393580 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.393665 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.393881 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.393965 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.394209 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.394308 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.394518 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.394602 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.394821 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.394905 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.395126 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.395212 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.395430 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.395513 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.395759 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.395851 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.396062 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.396152 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.396420 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.396587 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.396726 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.396812 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.397030 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.397116 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.397333 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.397426 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.397642 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.397725 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.397945 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.398031 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.398247 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.398344 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.398548 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.398632 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.398848 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.398933 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.399145 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.399229 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.399447 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.399534 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.399750 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.399837 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.400047 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.400130 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.400356 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.400472 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.400684 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.400769 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.400998 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.401081 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.401296 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.401392 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.401606 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.401698 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.401963 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.402593 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.402746 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.402874 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.403095 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.403178 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.403338 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.403423 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.403640 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.403734 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.403960 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.404044 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.404270 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.404354 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.404606 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.404736 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.404914 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.405002 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.405219 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.405303 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.405534 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.405628 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.405839 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.405930 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.406143 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.406227 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.406444 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.406529 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.406746 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.406837 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.407053 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.407185 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.407356 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.407443 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.407901 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.408000 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.408220 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.408313 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.408545 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.408631 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.408850 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.408936 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.409155 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.409249 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.409455 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.409539 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.409759 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.409843 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.410058 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.410150 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.410371 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.410463 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.410679 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.410764 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.410981 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.411143 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.411281 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.411365 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.411582 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.411672 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.411887 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.411979 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.412189 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.412281 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.412523 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.412613 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.412825 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.412912 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.413127 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.413211 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.413428 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.413511 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.413730 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.413816 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.414031 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.414116 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.414340 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.414424 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.414648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.414733 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.414947 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.415031 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.415250 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.415342 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.415554 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.415640 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.415855 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.415944 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.416156 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.416299 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.416487 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.416635 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.416792 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.416941 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.417095 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.417284 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.417404 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.417647 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.417853 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.417938 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.418178 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.418307 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.418477 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.418563 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.418787 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.418884 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.419088 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.419188 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.419391 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.419483 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.419694 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.419780 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.419994 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.420088 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.420290 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.420377 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.420619 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.420751 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.420927 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.421014 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.421227 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.421312 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.421528 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.421612 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.421848 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.421934 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.422156 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.422244 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.422456 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.422543 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.422758 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.422878 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.423059 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.423154 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.423364 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.423460 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.423678 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.423763 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.423988 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.424072 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.424300 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.424415 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.424638 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.424736 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.424951 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.425036 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.425258 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.425358 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.425565 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.425651 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.425869 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.425953 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.426166 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.426258 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.426473 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.426563 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.426778 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.426861 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.427087 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.427173 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.427387 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.427484 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.427688 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.427780 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.427994 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.428086 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.428303 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.428432 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.428636 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.428731 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.428939 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.429030 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.429258 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.429349 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.429583 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.429704 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.429884 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.429989 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.430189 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.430290 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.430501 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.430608 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.430812 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.430901 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.431120 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.431208 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.431427 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.431527 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.431729 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.431814 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.432035 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.432145 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.432344 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.432482 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.432694 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.432786 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.432989 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.433080 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.433385 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.433582 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.433679 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.433795 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.434071 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.434157 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.434378 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.434465 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.434697 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.434783 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.435001 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.435088 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.435302 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.435388 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.435610 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.435697 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.435914 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.436006 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.436220 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.436306 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.436546 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.436646 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.436959 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.437053 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.437265 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.437374 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.437574 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.437671 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.437875 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.437971 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.438183 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.438271 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.438492 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.438579 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.438806 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.438901 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.439116 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.439202 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.439419 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.439535 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.439776 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.439949 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.440085 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.440197 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.440426 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.440525 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.440741 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.440845 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.441049 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.441137 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.441350 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.441437 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.441654 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.441740 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.441972 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.442058 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.442275 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.442371 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.442575 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.442662 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.442876 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.442961 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.443195 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.443311 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.443495 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.443585 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.443812 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.443907 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.444203 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.444288 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.444545 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.444634 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.444851 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.444938 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.445156 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.445244 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.445465 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.445552 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.445772 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.445859 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.446078 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.446171 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.446397 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.446498 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.446702 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.446788 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.447014 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.447100 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.447326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.447421 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.447634 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.447719 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.447936 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.448021 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.448243 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.448338 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.448585 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.448691 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.449449 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.449539 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.449784 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.449972 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.450100 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.450310 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.450425 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.450631 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.450793 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.450944 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.451031 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.451261 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.451348 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.451643 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.451737 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.451953 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.452086 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.452255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.452418 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.452584 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.452687 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.452921 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.453007 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.453226 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.453311 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.453526 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.453621 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.453836 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.453930 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.454140 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.454230 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.454445 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.454534 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.454762 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.454848 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.455066 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.455153 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.455379 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.455467 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.455689 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.455786 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.455997 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.456085 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.456300 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.456407 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.456627 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.456712 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.456940 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.457025 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.457241 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.457329 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.457541 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.457627 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.457847 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.457946 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.458158 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.458245 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.458462 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.458554 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.458763 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.458857 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.459066 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.459152 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.459375 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.459460 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.459677 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.459776 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.459978 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.460073 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.460280 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.460374 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.460607 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.460735 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.460912 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.460999 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.461214 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.461300 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.461557 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.461645 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.461863 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.461948 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.462176 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.462269 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.462486 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.462575 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.462810 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.462897 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.463125 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.463229 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.463442 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.463531 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.463755 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.463840 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.464055 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.464141 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.464414 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.464997 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.465237 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.465343 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.465629 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.465731 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.465938 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.466026 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.466243 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.466330 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.466553 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.466648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.466855 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.466942 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.467157 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.467388 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.467523 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.467722 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.467813 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.468040 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.468129 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.468354 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.468477 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.468690 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.468790 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.468993 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.469078 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.469296 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.469390 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.469598 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.469690 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.469912 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.470071 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.470211 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.470356 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.470522 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.470668 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.470822 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.470964 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.471137 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.471288 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.471453 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.471592 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.471769 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.471908 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.472082 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.472246 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.472437 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.472527 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.472717 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.472803 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.473031 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.473196 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.473343 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.473429 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.473651 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.473738 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.473964 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.474053 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.474276 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.474370 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.474588 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.474683 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.474904 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.475111 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.475205 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.475443 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.475530 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.475762 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.475851 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.476079 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.476173 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.476411 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.476502 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.476733 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.476821 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.477046 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.477132 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.477358 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.477458 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.477669 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.477755 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.477980 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.478067 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.478291 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.478395 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.478610 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.478695 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.478924 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.479010 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.479240 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.479336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.479574 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.479759 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.479891 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.480104 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.480277 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.480460 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.480668 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.480791 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.480992 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.481115 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.481347 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.481438 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.481668 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.481755 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.481976 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.482073 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.482291 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.482386 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.482606 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.482700 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.482919 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.483014 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.483227 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.483313 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.483537 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.483622 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.483850 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.483946 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.484158 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.484250 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.484485 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.484574 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.484796 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.484892 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.485101 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.485194 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.485411 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.485642 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.485737 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.485993 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.486087 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.486312 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.486399 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.486639 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.486735 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.486949 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.487037 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.487263 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.487349 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.487567 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.487777 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.487891 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.488091 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.488200 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.488448 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.488536 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.488775 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.488871 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.489095 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.489181 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.489409 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.489503 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.489712 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.489798 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.490024 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.490109 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.490326 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.490434 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.490627 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.490714 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.490934 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.491019 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.491236 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.491330 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.491540 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.491633 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.491854 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.491940 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.492158 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.492256 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.492483 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.492573 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.492799 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.492895 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.493102 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.493197 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.493410 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.493626 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.493713 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.493969 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.494068 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.494282 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.494359 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.494591 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.494692 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.494898 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.494995 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.495201 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.495287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.495501 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.495586 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.496329 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.496690 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.496820 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.497001 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.497135 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.497308 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.497462 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.497627 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.497771 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.497938 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.498120 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.498243 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.498439 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.498548 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.498750 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.498858 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.499073 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.499162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.499388 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.499476 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.499702 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.499804 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.500034 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.500127 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.500354 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.500468 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.500686 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.500911 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.501013 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.501246 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.501335 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.501568 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.501662 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.501875 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.501963 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.502176 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.502266 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.502479 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.502573 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.502781 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.502857 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.503090 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.503188 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.503390 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.503495 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.503696 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.503784 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.503997 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.504086 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.504308 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.504453 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.504636 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.504735 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.504943 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.505030 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.505243 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.505329 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.505557 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.505651 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.505858 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.505943 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.506167 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.506252 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.506478 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.506578 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.506788 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.506875 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.507100 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.507185 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.507408 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.507501 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.507713 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.507798 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.508029 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.508114 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.508352 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.508456 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.508697 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.508909 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.509016 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.509241 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.509340 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.509560 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.509655 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.509891 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.509979 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.510220 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.510387 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.510526 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.510626 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.510830 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.510918 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.511133 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.511221 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.512005 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.512153 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.512314 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.512600 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.512704 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.512920 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.513007 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.513244 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.513348 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.513553 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.513655 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.513862 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.513959 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.514169 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.514257 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.514476 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.514566 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.514783 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.514870 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.515089 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.515175 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.515396 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.515484 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.515701 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.515787 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.516005 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.516100 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.516312 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.516438 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.516650 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.516738 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.516984 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.517089 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.517300 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.517395 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.517614 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.517705 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.517927 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.518022 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.518241 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.518329 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.518567 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.518663 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.518853 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.518953 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.519159 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.519253 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.519460 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.519546 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.519764 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.519852 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.520074 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.520161 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.520379 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.520550 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.520707 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.520842 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.521014 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.521109 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.521317 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.521403 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.521627 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.521716 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.521930 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.522026 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.522233 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.522319 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.522536 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.522624 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.522842 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.522943 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.523138 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.523235 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.523440 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.523526 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.523749 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.523844 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.524058 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.524168 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.524362 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.524519 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.524688 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.524775 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.524997 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.525159 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.525297 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.525440 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.525610 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.525750 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.525942 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.526031 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.526252 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.526382 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.526570 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.526658 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.526904 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.527054 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.527203 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.527356 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.527501 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.527774 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.527870 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.528094 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.528180 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.528439 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.528531 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.528722 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.528823 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.529024 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.529113 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.529332 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.529420 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.529631 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.529719 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.529932 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.530018 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.530233 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.530320 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.530534 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.530622 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.530834 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.530927 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.531135 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.531229 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.531441 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.531533 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.531748 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.531834 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.532049 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.532135 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.532350 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.532469 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.532929 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.533022 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.533231 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.533330 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.533560 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.533647 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.533875 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.533960 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.534189 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.534294 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.534502 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.534588 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.534808 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.534893 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.535117 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.535215 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.535421 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.535506 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.535731 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.535825 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.536046 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.536134 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.536355 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.536483 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.536685 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.536770 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.537002 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.537089 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.537327 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.537433 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.537624 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.537726 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.537934 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.538023 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.538243 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.538327 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.538549 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.538643 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.538857 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.538944 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.539181 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.539275 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.539506 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.539671 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.539811 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.539898 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.540132 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.540226 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.540471 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.540575 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.540788 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.540886 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.541095 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.541191 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.541341 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 15:14:23.541439 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.541721 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.542030 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.542338 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.542677 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.542980 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.543287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.543600 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.543908 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.544219 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.544567 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.544881 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.545205 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.545527 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.545834 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.546158 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.546481 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.546822 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.547135 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.547475 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.547800 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.548112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.548444 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.548750 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:14:23.548992 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 15:14:23.695369 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO dbcounter [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] Registered counter for database nova_api Aug 19 15:14:23.702776 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO dbcounter [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] Registered counter for database nova_api Aug 19 15:14:23.717446 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_db.sqlalchemy.engines [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:14:23.722335 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG oslo_db.sqlalchemy.engines [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:14:23.724138 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writer thread running {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:14:23.728754 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writer thread running {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:14:23.781834 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.context [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0(cell1) {{(pid=105502) load_cells /opt/stack/nova/nova/context.py:464}} Aug 19 15:14:23.785340 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.context [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0(cell1) {{(pid=105503) load_cells /opt/stack/nova/nova/context.py:464}} Aug 19 15:14:23.785885 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:14:23.786361 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:14:23.787943 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:14:23.788679 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:14:23.789128 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:14:23.789241 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:14:23.789619 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:14:23.791120 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:14:23.791212 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:14:23.791894 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:14:23.792338 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:14:23.793397 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO dbcounter [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] Registered counter for database nova_cell0 Aug 19 15:14:23.794351 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG oslo_concurrency.lockutils [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:14:23.796336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO dbcounter [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] Registered counter for database nova_cell0 Aug 19 15:14:23.799072 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO dbcounter [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] Registered counter for database nova_cell1 Aug 19 15:14:23.801819 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO dbcounter [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] Registered counter for database nova_cell1 Aug 19 15:14:23.807868 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_db.sqlalchemy.engines [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:14:23.811279 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG oslo_db.sqlalchemy.engines [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:14:23.811466 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_db.sqlalchemy.engines [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:14:23.812910 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writer thread running {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:14:23.814298 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG oslo_db.sqlalchemy.engines [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:14:23.818132 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writer thread running {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:14:23.954488 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writer thread running {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:14:23.956910 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writer thread running {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:14:23.963060 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO dbcounter [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] Registered counter for database nova_cell0 Aug 19 15:14:23.967783 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO dbcounter [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] Registered counter for database nova_cell0 Aug 19 15:14:23.970849 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_db.sqlalchemy.engines [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:14:23.975221 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writer thread running {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:14:23.976866 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG oslo_db.sqlalchemy.engines [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:14:23.981472 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writer thread running {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:14:24.329173 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: WARNING keystonemiddleware.auth_token [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 15:14:24.331047 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: WARNING keystonemiddleware.auth_token [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 15:14:24.336481 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: WARNING keystonemiddleware.auth_token [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 15:14:24.338321 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: WARNING keystonemiddleware.auth_token [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 15:14:24.687862 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: WARNING keystonemiddleware.auth_token [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 15:14:24.689231 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: WARNING keystonemiddleware.auth_token [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 15:14:24.693967 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: WARNING keystonemiddleware.auth_token [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 15:14:24.695183 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: WARNING keystonemiddleware.auth_token [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 15:14:24.699410 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ae44d999c0 pid: 105503 (default app) Aug 19 15:14:24.700560 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ae44d999c0 pid: 105502 (default app) Aug 19 15:14:24.701497 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:14:24.702673 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-42788032-9f5e-495b-9d06-cf6ec71518df None None] 10.222.0.75 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001728 Aug 19 15:14:24.703083 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 788 bytes} [Fri Aug 19 15:14:24 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:15:43.619407 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:15:43.620589 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002174 Aug 19 15:15:43.620998 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 1/2] 10.222.0.75 () {54 vars in 931 bytes} [Fri Aug 19 15:15:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:15:43.637480 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_api:SELECT=3 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:43.639681 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_cell0:SELECT=3 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:43.641035 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_cell1:SELECT=3 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:43.642263 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:44.885986 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-a9f680f6-7ad1-49b4-9296-5db9c9d80836 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:15:44.937035 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-a9f680f6-7ad1-49b4-9296-5db9c9d80836 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.308146 Aug 19 15:15:44.938220 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 2/3] 10.222.0.75 () {60 vars in 1292 bytes} [Fri Aug 19 15:15:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:15:47.598015 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:15:47.599017 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-209edd61-9cb1-489f-84e8-6631e60bdd32 None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 19 15:15:47.599574 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 2/4] 10.222.0.75 () {54 vars in 931 bytes} [Fri Aug 19 15:15:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:15:48.099142 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-d969c035-b6af-47bc-ab23-877f162fbf7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256", "id": "c1", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:15:48.119509 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:15:48.119509 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: warnings.warn(msg) Aug 19 15:15:48.155287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-d969c035-b6af-47bc-ab23-877f162fbf7f admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.548645 Aug 19 15:15:48.156376 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 3/5] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Aug 19 15:15:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 15:15:48.174654 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=3 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:48.175648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_cell1:SELECT=3 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:48.177154 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_cell0:SELECT=3 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:48.178105 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:48.407514 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-7f6ae54b-562a-4397-a5c4-9c4f1d699e5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:15:48.412493 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:15:48.412493 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: warnings.warn(msg) Aug 19 15:15:48.490202 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-7f6ae54b-562a-4397-a5c4-9c4f1d699e5f admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.321451 Aug 19 15:15:48.493325 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 3/6] 10.222.0.75 () {64 vars in 1336 bytes} [Fri Aug 19 15:15:48 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:15:51.312859 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-d969c035-b6af-47bc-ab23-877f162fbf7f admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:15:51.314394 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-d969c035-b6af-47bc-ab23-877f162fbf7f admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002245 Aug 19 15:15:51.315001 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 4/7] 10.222.0.75 () {54 vars in 931 bytes} [Fri Aug 19 15:15:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:15:52.169104 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-b71b2545-25ad-4206-91ba-fee75c116048 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "disk": 5, "id": "d1", "name": "ds512M", "swap": 0}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:15:52.188613 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:15:52.188613 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: warnings.warn(msg) Aug 19 15:15:52.208640 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-b71b2545-25ad-4206-91ba-fee75c116048 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.884127 Aug 19 15:15:52.209739 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 4/8] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Aug 19 15:15:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 15:15:52.222400 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-80bbd89c-c55e-41fa-b6a0-4a4eba284e53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:15:52.225400 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:15:52.225400 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: warnings.warn(msg) Aug 19 15:15:52.267245 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-80bbd89c-c55e-41fa-b6a0-4a4eba284e53 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048867 Aug 19 15:15:52.267944 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 5/9] 10.222.0.75 () {64 vars in 1336 bytes} [Fri Aug 19 15:15:52 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:15:54.915766 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-b71b2545-25ad-4206-91ba-fee75c116048 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:15:54.916702 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-b71b2545-25ad-4206-91ba-fee75c116048 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 19 15:15:54.917105 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 5/10] 10.222.0.75 () {54 vars in 931 bytes} [Fri Aug 19 15:15:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:15:55.396193 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-af0e2e48-4d28-4a91-b976-8a20500985c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "name": "ds1G"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:15:55.416345 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-af0e2e48-4d28-4a91-b976-8a20500985c5 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489129 Aug 19 15:15:55.416942 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 6/11] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Aug 19 15:15:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 15:15:55.433112 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-134b4e56-1492-4d6e-affe-7cd4f67ff106 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:15:55.463795 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-134b4e56-1492-4d6e-affe-7cd4f67ff106 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037450 Aug 19 15:15:55.464304 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 6/12] 10.222.0.75 () {64 vars in 1336 bytes} [Fri Aug 19 15:15:55 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:15:58.182976 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-af0e2e48-4d28-4a91-b976-8a20500985c5 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:15:58.183912 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-af0e2e48-4d28-4a91-b976-8a20500985c5 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 19 15:15:58.184312 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 7/13] 10.222.0.75 () {54 vars in 931 bytes} [Fri Aug 19 15:15:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:15:58.627984 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-576de363-c5f6-49a6-aa70-7222dab01bd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:15:58.647855 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-576de363-c5f6-49a6-aa70-7222dab01bd7 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.456238 Aug 19 15:15:58.648826 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 7/14] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Aug 19 15:15:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 15:15:58.661109 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-76d5c7c0-3635-46bd-a4f5-d91631f0d92d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:15:58.705575 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-76d5c7c0-3635-46bd-a4f5-d91631f0d92d admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038638 Aug 19 15:15:58.705575 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 8/15] 10.222.0.75 () {64 vars in 1336 bytes} [Fri Aug 19 15:15:58 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:16:01.325034 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-576de363-c5f6-49a6-aa70-7222dab01bd7 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:01.326446 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-576de363-c5f6-49a6-aa70-7222dab01bd7 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 19 15:16:01.327421 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 8/16] 10.222.0.75 () {54 vars in 931 bytes} [Fri Aug 19 15:16:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:16:01.782547 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-72e8c1a0-beca-446b-842e-aecb9133861c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "disk": 20, "os-flavor-access:is_public": true, "name": "ds4G", "ram": 4096}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:16:01.805283 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-72e8c1a0-beca-446b-842e-aecb9133861c admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.470132 Aug 19 15:16:01.808758 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 9/17] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Aug 19 15:16:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 15:16:01.817602 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-db1336af-0202-4e21-83de-51425a551083 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:16:01.845402 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-db1336af-0202-4e21-83de-51425a551083 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031331 Aug 19 15:16:01.846069 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 9/18] 10.222.0.75 () {64 vars in 1336 bytes} [Fri Aug 19 15:16:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:16:04.714293 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-72e8c1a0-beca-446b-842e-aecb9133861c admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:04.715325 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-72e8c1a0-beca-446b-842e-aecb9133861c admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 19 15:16:04.715718 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 10/19] 10.222.0.75 () {54 vars in 931 bytes} [Fri Aug 19 15:16:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:16:05.271626 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-7da0541d-3148-4525-bdac-0c1620c75ea0 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:05.306643 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-7da0541d-3148-4525-bdac-0c1620c75ea0 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.583225 Aug 19 15:16:05.307370 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 10/20] 10.222.0.75 () {60 vars in 1292 bytes} [Fri Aug 19 15:16:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 15:16:08.429302 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-72e8c1a0-beca-446b-842e-aecb9133861c admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:08.430766 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-72e8c1a0-beca-446b-842e-aecb9133861c admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001892 Aug 19 15:16:08.431312 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 11/21] 10.222.0.75 () {54 vars in 931 bytes} [Fri Aug 19 15:16:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:16:08.871237 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-7d19ce21-828c-4607-b78c-489227c78ef3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "ram": 512, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:16:08.894109 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-7d19ce21-828c-4607-b78c-489227c78ef3 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.455117 Aug 19 15:16:08.894942 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 11/22] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Aug 19 15:16:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 15:16:08.907489 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-cdc8feae-4cf8-49c1-ba00-e3cac9bd6451 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:16:08.932619 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-cdc8feae-4cf8-49c1-ba00-e3cac9bd6451 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028984 Aug 19 15:16:08.933198 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 12/23] 10.222.0.75 () {64 vars in 1333 bytes} [Fri Aug 19 15:16:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:16:11.468475 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-7d19ce21-828c-4607-b78c-489227c78ef3 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:11.469478 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-7d19ce21-828c-4607-b78c-489227c78ef3 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 19 15:16:11.469880 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 12/24] 10.222.0.75 () {54 vars in 931 bytes} [Fri Aug 19 15:16:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:16:11.998027 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-e11beef8-f3f4-4b48-ad08-ca498acccb49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:16:12.019433 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-e11beef8-f3f4-4b48-ad08-ca498acccb49 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.542808 Aug 19 15:16:12.019994 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 13/25] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Aug 19 15:16:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 15:16:12.035616 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-33c0a145-3df0-4f2e-ac74-e03a655bdef0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:16:12.062194 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-33c0a145-3df0-4f2e-ac74-e03a655bdef0 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031262 Aug 19 15:16:12.062770 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 13/26] 10.222.0.75 () {64 vars in 1333 bytes} [Fri Aug 19 15:16:12 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:16:15.014394 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-e11beef8-f3f4-4b48-ad08-ca498acccb49 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:15.015526 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-e11beef8-f3f4-4b48-ad08-ca498acccb49 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001625 Aug 19 15:16:15.016122 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 14/27] 10.222.0.75 () {54 vars in 931 bytes} [Fri Aug 19 15:16:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:16:15.519808 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-c21ffa6c-4e52-4642-a90d-95284b8e5a31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 2, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:16:15.542736 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-c21ffa6c-4e52-4642-a90d-95284b8e5a31 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.519452 Aug 19 15:16:15.543494 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 14/28] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Aug 19 15:16:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 15:16:15.555864 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-051840b2-170e-4655-a84a-76b448ff2e4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:16:15.565826 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:15.586593 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-051840b2-170e-4655-a84a-76b448ff2e4b admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034402 Aug 19 15:16:15.587410 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 15/29] 10.222.0.75 () {64 vars in 1333 bytes} [Fri Aug 19 15:16:15 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:16:18.276588 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-c21ffa6c-4e52-4642-a90d-95284b8e5a31 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:18.278855 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-c21ffa6c-4e52-4642-a90d-95284b8e5a31 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002225 Aug 19 15:16:18.279266 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 15/30] 10.222.0.75 () {54 vars in 931 bytes} [Fri Aug 19 15:16:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:16:18.825656 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-12631f96-be7d-44d9-90e1-040282864d44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "name": "m1.large", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:16:18.857187 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-12631f96-be7d-44d9-90e1-040282864d44 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.569819 Aug 19 15:16:18.864473 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 16/31] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Aug 19 15:16:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 15:16:18.871741 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-61626767-4c75-45ca-a9de-e9b5e37e0981 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:16:18.880479 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:18.918092 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-61626767-4c75-45ca-a9de-e9b5e37e0981 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050949 Aug 19 15:16:18.919328 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 16/32] 10.222.0.75 () {64 vars in 1333 bytes} [Fri Aug 19 15:16:18 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:16:21.414669 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-12631f96-be7d-44d9-90e1-040282864d44 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:21.415683 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-12631f96-be7d-44d9-90e1-040282864d44 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 19 15:16:21.416085 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 17/33] 10.222.0.75 () {54 vars in 931 bytes} [Fri Aug 19 15:16:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:16:21.903007 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-a4423e16-3f81-4a30-981b-5cd17a2e9e09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160, "rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge", "vcpus": 8, "ram": 16384}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:16:21.927715 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-a4423e16-3f81-4a30-981b-5cd17a2e9e09 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.504282 Aug 19 15:16:21.928513 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 17/34] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Aug 19 15:16:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 15:16:21.941057 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-adeb144f-d4f1-4258-a78e-ca5123142093 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:16:21.975309 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-adeb144f-d4f1-4258-a78e-ca5123142093 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037904 Aug 19 15:16:21.976201 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 18/35] 10.222.0.75 () {64 vars in 1333 bytes} [Fri Aug 19 15:16:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:16:39.066044 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-a4423e16-3f81-4a30-981b-5cd17a2e9e09 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:39.067078 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-a4423e16-3f81-4a30-981b-5cd17a2e9e09 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 19 15:16:39.067482 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 18/36] 10.222.0.75 () {54 vars in 931 bytes} [Fri Aug 19 15:16:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:16:39.078016 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:39.464235 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-dcbeb044-734e-40d0-8cdd-e507806cbf03 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:39.483208 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-dcbeb044-734e-40d0-8cdd-e507806cbf03 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409612 Aug 19 15:16:39.483743 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 19/37] 10.222.0.75 () {60 vars in 1292 bytes} [Fri Aug 19 15:16:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:16:40.548003 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-a4423e16-3f81-4a30-981b-5cd17a2e9e09 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:40.549047 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-a4423e16-3f81-4a30-981b-5cd17a2e9e09 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 19 15:16:40.549439 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 19/38] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Aug 19 15:16:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:16:41.078822 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-fa78a8da-5a7d-4507-bf95-ca4f3605a3fb admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:41.084254 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.wsgi [None req-fa78a8da-5a7d-4507-bf95-ca4f3605a3fb admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-fa78a8da-5a7d-4507-bf95-ca4f3605a3fb admin admin] Request method failure captured: Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Accept: application/json Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Accept-Encoding: gzip, deflate Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Connection: keep-alive Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Content-Length: 0 Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Host: 10.222.0.75 Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Openstack-Api-Version: compute 2.90 Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Openstack-System-Scope: None Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: User-Agent: python-novaclient Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Auth-Token: gAAAAABi_6lY5Q6oyvAtHsct1V_hJYcjtnFowj_Uo77h__z_mKxwRi6Dm2oNb_91A-6B9qL_JK6N-OLNHRCnmYtgiIbheLRWjH0BxkPiyrb_jtImXxks8x6LSgGUt-0VwJqmGtcj9VbW-KTjxabawGl7wEoZADkqHA19USt7-OnCBVf7Z-lTQHE Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Domain-Id: None Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Domain-Name: None Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Identity-Status: Confirmed Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Is-Admin-Project: True Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Openstack-Nova-Api-Version: 2.90 Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Project-Domain-Id: default Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Project-Domain-Name: Default Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Project-Id: a9a96491d392440daeaecef9eef8a152 Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Project-Name: admin Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Role: member,reader,admin Aug 19 15:16:41.087503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Roles: member,reader,admin Aug 19 15:16:41.089198 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a9a96491d392440daeaecef9eef8a152", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9a96491d392440daeaecef9eef8a152"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9a96491d392440daeaecef9eef8a152"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a9a96491d392440daeaecef9eef8a152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:16:41.089198 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Tenant: admin Aug 19 15:16:41.089198 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Tenant-Id: a9a96491d392440daeaecef9eef8a152 Aug 19 15:16:41.089198 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Tenant-Name: admin Aug 19 15:16:41.089198 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-User: admin Aug 19 15:16:41.089198 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-User-Domain-Id: default Aug 19 15:16:41.089198 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-User-Domain-Name: Default Aug 19 15:16:41.089198 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-User-Id: 0ba95fb65871415ca38c574ddd6396b8 Aug 19 15:16:41.089198 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-User-Name: admin Aug 19 15:16:41.089198 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: method: > Aug 19 15:16:41.089198 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: exception: Flavor 42 could not be found. Aug 19 15:16:41.089198 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: action_args: {'id': '42'} Aug 19 15:16:41.089198 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:16:41.089198 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:16:41.090336 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:16:41.091820 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:16:41.091820 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:16:41.091820 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:16:41.091820 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:16:41.091820 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 19 15:16:41.091820 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:16:41.091820 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 19 15:16:41.091820 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 19 15:16:41.091820 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:16:41.091820 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 19 15:16:41.091820 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:16:41.091820 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:16:41.091820 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:16:41.091820 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:16:41.091820 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:16:41.091820 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 19 15:16:41.091820 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 19 15:16:41.091820 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-fa78a8da-5a7d-4507-bf95-ca4f3605a3fb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:16:41.093119 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-fa78a8da-5a7d-4507-bf95-ca4f3605a3fb admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.401003 Aug 19 15:16:41.093119 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 20/39] 10.222.0.75 () {60 vars in 1190 bytes} [Fri Aug 19 15:16:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 19 15:16:41.098557 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-39d002f9-69b9-47d5-8d5a-5ae74745b10e admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:41.102560 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:41.123191 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-39d002f9-69b9-47d5-8d5a-5ae74745b10e admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028140 Aug 19 15:16:41.123741 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 20/40] 10.222.0.75 () {60 vars in 1210 bytes} [Fri Aug 19 15:16:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:16:41.133460 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-8034a7d8-be50-4789-be4a-404d27fe8a9b admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:41.157438 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-8034a7d8-be50-4789-be4a-404d27fe8a9b admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027538 Aug 19 15:16:41.158002 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 21/41] 10.222.0.75 () {60 vars in 1210 bytes} [Fri Aug 19 15:16:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:16:41.168601 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-19cfe6af-65e1-4284-a6e6-7679fe87e131 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:41.174621 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.wsgi [None req-19cfe6af-65e1-4284-a6e6-7679fe87e131 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-19cfe6af-65e1-4284-a6e6-7679fe87e131 admin admin] Request method failure captured: Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Accept: application/json Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Accept-Encoding: gzip, deflate Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Connection: keep-alive Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Content-Length: 0 Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Host: 10.222.0.75 Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Openstack-Api-Version: compute 2.90 Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Openstack-System-Scope: None Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: User-Agent: python-novaclient Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Auth-Token: gAAAAABi_6lY5Q6oyvAtHsct1V_hJYcjtnFowj_Uo77h__z_mKxwRi6Dm2oNb_91A-6B9qL_JK6N-OLNHRCnmYtgiIbheLRWjH0BxkPiyrb_jtImXxks8x6LSgGUt-0VwJqmGtcj9VbW-KTjxabawGl7wEoZADkqHA19USt7-OnCBVf7Z-lTQHE Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Domain-Id: None Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Domain-Name: None Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Identity-Status: Confirmed Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Is-Admin-Project: True Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Openstack-Nova-Api-Version: 2.90 Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Project-Domain-Id: default Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Project-Domain-Name: Default Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Project-Id: a9a96491d392440daeaecef9eef8a152 Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Project-Name: admin Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Role: member,reader,admin Aug 19 15:16:41.177862 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Roles: member,reader,admin Aug 19 15:16:41.179266 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a9a96491d392440daeaecef9eef8a152", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9a96491d392440daeaecef9eef8a152"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9a96491d392440daeaecef9eef8a152"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a9a96491d392440daeaecef9eef8a152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:16:41.179266 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Tenant: admin Aug 19 15:16:41.179266 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Tenant-Id: a9a96491d392440daeaecef9eef8a152 Aug 19 15:16:41.179266 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Tenant-Name: admin Aug 19 15:16:41.179266 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-User: admin Aug 19 15:16:41.179266 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-User-Domain-Id: default Aug 19 15:16:41.179266 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-User-Domain-Name: Default Aug 19 15:16:41.179266 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-User-Id: 0ba95fb65871415ca38c574ddd6396b8 Aug 19 15:16:41.179266 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-User-Name: admin Aug 19 15:16:41.179266 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: method: > Aug 19 15:16:41.179266 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: exception: Flavor 42 could not be found. Aug 19 15:16:41.179266 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: action_args: {'id': '42'} Aug 19 15:16:41.179266 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:16:41.179266 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:16:41.180131 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:16:41.181326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:16:41.181326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:16:41.181326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:16:41.181326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:16:41.181326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 19 15:16:41.181326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:16:41.181326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 19 15:16:41.181326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 19 15:16:41.181326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:16:41.181326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 19 15:16:41.181326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:16:41.181326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:16:41.181326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:16:41.181326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:16:41.181326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:16:41.181326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 19 15:16:41.181326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 19 15:16:41.181326 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-19cfe6af-65e1-4284-a6e6-7679fe87e131 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:16:41.182338 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-19cfe6af-65e1-4284-a6e6-7679fe87e131 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015250 Aug 19 15:16:41.182338 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 21/42] 10.222.0.75 () {60 vars in 1190 bytes} [Fri Aug 19 15:16:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 19 15:16:42.144795 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-8034a7d8-be50-4789-be4a-404d27fe8a9b admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:42.145799 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-8034a7d8-be50-4789-be4a-404d27fe8a9b admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 19 15:16:42.146197 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 22/43] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Aug 19 15:16:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:16:42.679118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-090f813f-c26d-4a19-a6b8-cbbe2399413d admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:42.684777 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.wsgi [None req-090f813f-c26d-4a19-a6b8-cbbe2399413d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-090f813f-c26d-4a19-a6b8-cbbe2399413d admin admin] Request method failure captured: Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Accept: application/json Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Accept-Encoding: gzip, deflate Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Connection: keep-alive Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Content-Length: 0 Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Host: 10.222.0.75 Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Openstack-Api-Version: compute 2.90 Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Openstack-System-Scope: None Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: User-Agent: python-novaclient Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Auth-Token: gAAAAABi_6laZyW2XYgza2CC6nk97WufPGCCbw2Tz84GgOeua5-xucnDxv9fV_lwu9ZSnCLoeg7IuISAWjT09k527Og8o2spKZYAUBkpXTiWQEHRo3_cbp_xDesfjZVUGiJcr9Rl8KSpHE6P91fAeNV-c_IAeUVNasEunH5R1Y0L8khlBGO1IxI Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Domain-Id: None Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Domain-Name: None Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Identity-Status: Confirmed Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Is-Admin-Project: True Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Openstack-Nova-Api-Version: 2.90 Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Project-Domain-Id: default Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Project-Domain-Name: Default Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Project-Id: a9a96491d392440daeaecef9eef8a152 Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Project-Name: admin Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Role: member,reader,admin Aug 19 15:16:42.686255 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Roles: member,reader,admin Aug 19 15:16:42.687741 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a9a96491d392440daeaecef9eef8a152", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9a96491d392440daeaecef9eef8a152"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9a96491d392440daeaecef9eef8a152"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a9a96491d392440daeaecef9eef8a152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:16:42.687741 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Tenant: admin Aug 19 15:16:42.687741 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Tenant-Id: a9a96491d392440daeaecef9eef8a152 Aug 19 15:16:42.687741 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Tenant-Name: admin Aug 19 15:16:42.687741 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-User: admin Aug 19 15:16:42.687741 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-User-Domain-Id: default Aug 19 15:16:42.687741 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-User-Domain-Name: Default Aug 19 15:16:42.687741 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-User-Id: 0ba95fb65871415ca38c574ddd6396b8 Aug 19 15:16:42.687741 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-User-Name: admin Aug 19 15:16:42.687741 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: method: > Aug 19 15:16:42.687741 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: exception: Flavor 84 could not be found. Aug 19 15:16:42.687741 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: action_args: {'id': '84'} Aug 19 15:16:42.687741 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:16:42.687741 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:16:42.688597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:16:42.689648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:16:42.689648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:16:42.689648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:16:42.689648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:16:42.689648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 19 15:16:42.689648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:16:42.689648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 19 15:16:42.689648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 19 15:16:42.689648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:16:42.689648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 19 15:16:42.689648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:16:42.689648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:16:42.689648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:16:42.689648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:16:42.689648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:16:42.689648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 19 15:16:42.689648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 19 15:16:42.689648 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-090f813f-c26d-4a19-a6b8-cbbe2399413d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:16:42.690681 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-090f813f-c26d-4a19-a6b8-cbbe2399413d admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.396336 Aug 19 15:16:42.690681 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 22/44] 10.222.0.75 () {60 vars in 1190 bytes} [Fri Aug 19 15:16:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 19 15:16:42.697185 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-fdfc98a3-cf6b-402c-b22c-7948acae15bd admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:42.712632 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-fdfc98a3-cf6b-402c-b22c-7948acae15bd admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018984 Aug 19 15:16:42.713161 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 23/45] 10.222.0.75 () {60 vars in 1210 bytes} [Fri Aug 19 15:16:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:16:42.723625 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-99727c0c-9d6f-4ec6-9fa0-4a6daf8f2d0a admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:42.738476 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-99727c0c-9d6f-4ec6-9fa0-4a6daf8f2d0a admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018285 Aug 19 15:16:42.738988 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 23/46] 10.222.0.75 () {60 vars in 1210 bytes} [Fri Aug 19 15:16:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 15:16:42.748430 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-3f7b640a-e150-48e9-af9c-551a24537fcd admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:42.753918 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.wsgi [None req-3f7b640a-e150-48e9-af9c-551a24537fcd admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-3f7b640a-e150-48e9-af9c-551a24537fcd admin admin] Request method failure captured: Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Accept: application/json Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Accept-Encoding: gzip, deflate Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Connection: keep-alive Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Content-Length: 0 Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Host: 10.222.0.75 Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Openstack-Api-Version: compute 2.90 Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Openstack-System-Scope: None Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: User-Agent: python-novaclient Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Auth-Token: gAAAAABi_6laZyW2XYgza2CC6nk97WufPGCCbw2Tz84GgOeua5-xucnDxv9fV_lwu9ZSnCLoeg7IuISAWjT09k527Og8o2spKZYAUBkpXTiWQEHRo3_cbp_xDesfjZVUGiJcr9Rl8KSpHE6P91fAeNV-c_IAeUVNasEunH5R1Y0L8khlBGO1IxI Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Domain-Id: None Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Domain-Name: None Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Identity-Status: Confirmed Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Is-Admin-Project: True Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Openstack-Nova-Api-Version: 2.90 Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Project-Domain-Id: default Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Project-Domain-Name: Default Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Project-Id: a9a96491d392440daeaecef9eef8a152 Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Project-Name: admin Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Role: member,reader,admin Aug 19 15:16:42.755450 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Roles: member,reader,admin Aug 19 15:16:42.757051 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a9a96491d392440daeaecef9eef8a152", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9a96491d392440daeaecef9eef8a152"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9a96491d392440daeaecef9eef8a152"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a9a96491d392440daeaecef9eef8a152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:16:42.757051 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Tenant: admin Aug 19 15:16:42.757051 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Tenant-Id: a9a96491d392440daeaecef9eef8a152 Aug 19 15:16:42.757051 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Tenant-Name: admin Aug 19 15:16:42.757051 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-User: admin Aug 19 15:16:42.757051 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-User-Domain-Id: default Aug 19 15:16:42.757051 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-User-Domain-Name: Default Aug 19 15:16:42.757051 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-User-Id: 0ba95fb65871415ca38c574ddd6396b8 Aug 19 15:16:42.757051 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-User-Name: admin Aug 19 15:16:42.757051 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: method: > Aug 19 15:16:42.757051 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: exception: Flavor 84 could not be found. Aug 19 15:16:42.757051 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: action_args: {'id': '84'} Aug 19 15:16:42.757051 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:16:42.757051 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:16:42.757973 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:16:42.759287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:16:42.759287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:16:42.759287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:16:42.759287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:16:42.759287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 19 15:16:42.759287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:16:42.759287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 19 15:16:42.759287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 19 15:16:42.759287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:16:42.759287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 19 15:16:42.759287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:16:42.759287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:16:42.759287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:16:42.759287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:16:42.759287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:16:42.759287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 19 15:16:42.759287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 19 15:16:42.759287 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-3f7b640a-e150-48e9-af9c-551a24537fcd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:16:42.760776 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-3f7b640a-e150-48e9-af9c-551a24537fcd admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012287 Aug 19 15:16:42.760776 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 24/47] 10.222.0.75 () {60 vars in 1190 bytes} [Fri Aug 19 15:16:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 19 15:16:43.750069 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-99727c0c-9d6f-4ec6-9fa0-4a6daf8f2d0a admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:43.751069 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-99727c0c-9d6f-4ec6-9fa0-4a6daf8f2d0a admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 19 15:16:43.751464 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 24/48] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Aug 19 15:16:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:16:44.289241 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-b35d6347-7d13-4c7c-9655-cb03ee550c29 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:44.295412 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.wsgi [None req-b35d6347-7d13-4c7c-9655-cb03ee550c29 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-b35d6347-7d13-4c7c-9655-cb03ee550c29 admin admin] Request method failure captured: Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Accept: application/json Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Accept-Encoding: gzip, deflate Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Connection: keep-alive Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Content-Length: 0 Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Host: 10.222.0.75 Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Openstack-Api-Version: compute 2.90 Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Openstack-System-Scope: None Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: User-Agent: python-novaclient Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Auth-Token: gAAAAABi_6lb0fD7P0C6aexBNsnw4K6ODaCP0fdsJOWRZ-SUG6WR2UvH5ivCVCMcQzuv16IItGbl9FR7veFTEGSFKNEqsPLQnwLHEXl-BuR5IympOfmGsluYi5vfRZpE0YaUeckxfeneAaWdLdawCgSlVAVMsskZwptkVD2rI2wmPErJ6SULRfs Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Domain-Id: None Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Domain-Name: None Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Identity-Status: Confirmed Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Is-Admin-Project: True Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Openstack-Nova-Api-Version: 2.90 Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Project-Domain-Id: default Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Project-Domain-Name: Default Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Project-Id: a9a96491d392440daeaecef9eef8a152 Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Project-Name: admin Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Role: member,reader,admin Aug 19 15:16:44.296920 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Roles: member,reader,admin Aug 19 15:16:44.298293 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a9a96491d392440daeaecef9eef8a152", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9a96491d392440daeaecef9eef8a152"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9a96491d392440daeaecef9eef8a152"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a9a96491d392440daeaecef9eef8a152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:16:44.298293 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Tenant: admin Aug 19 15:16:44.298293 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Tenant-Id: a9a96491d392440daeaecef9eef8a152 Aug 19 15:16:44.298293 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-Tenant-Name: admin Aug 19 15:16:44.298293 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-User: admin Aug 19 15:16:44.298293 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-User-Domain-Id: default Aug 19 15:16:44.298293 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-User-Domain-Name: Default Aug 19 15:16:44.298293 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-User-Id: 0ba95fb65871415ca38c574ddd6396b8 Aug 19 15:16:44.298293 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: X-User-Name: admin Aug 19 15:16:44.298293 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: method: > Aug 19 15:16:44.298293 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: exception: Flavor 451 could not be found. Aug 19 15:16:44.298293 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: action_args: {'id': '451'} Aug 19 15:16:44.298293 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:16:44.298293 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:16:44.299112 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:16:44.300162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:16:44.300162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:16:44.300162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:16:44.300162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:16:44.300162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 19 15:16:44.300162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:16:44.300162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 19 15:16:44.300162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 19 15:16:44.300162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:16:44.300162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 19 15:16:44.300162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:16:44.300162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:16:44.300162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:16:44.300162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:16:44.300162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:16:44.300162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 19 15:16:44.300162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: ERROR nova.api.openstack.wsgi Aug 19 15:16:44.300162 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-b35d6347-7d13-4c7c-9655-cb03ee550c29 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:16:44.301439 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-b35d6347-7d13-4c7c-9655-cb03ee550c29 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.408403 Aug 19 15:16:44.301439 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 25/49] 10.222.0.75 () {60 vars in 1193 bytes} [Fri Aug 19 15:16:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 19 15:16:44.308080 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-a7a17cab-f98c-4df3-a040-78036e75210a admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:44.323364 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-a7a17cab-f98c-4df3-a040-78036e75210a admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018862 Aug 19 15:16:44.323875 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 25/50] 10.222.0.75 () {60 vars in 1210 bytes} [Fri Aug 19 15:16:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:16:44.333650 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-d96f8bf3-b26d-4791-8623-8615f782bfd4 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:44.348917 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-d96f8bf3-b26d-4791-8623-8615f782bfd4 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018736 Aug 19 15:16:44.349431 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 26/51] 10.222.0.75 () {60 vars in 1210 bytes} [Fri Aug 19 15:16:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:16:44.358925 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-faae25a9-b9b7-425b-9505-9e29586dd1c7 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:44.364174 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.wsgi [None req-faae25a9-b9b7-425b-9505-9e29586dd1c7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-faae25a9-b9b7-425b-9505-9e29586dd1c7 admin admin] Request method failure captured: Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Accept: application/json Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Accept-Encoding: gzip, deflate Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Connection: keep-alive Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Content-Length: 0 Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Host: 10.222.0.75 Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Openstack-Api-Version: compute 2.90 Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Openstack-System-Scope: None Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: User-Agent: python-novaclient Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Auth-Token: gAAAAABi_6lb0fD7P0C6aexBNsnw4K6ODaCP0fdsJOWRZ-SUG6WR2UvH5ivCVCMcQzuv16IItGbl9FR7veFTEGSFKNEqsPLQnwLHEXl-BuR5IympOfmGsluYi5vfRZpE0YaUeckxfeneAaWdLdawCgSlVAVMsskZwptkVD2rI2wmPErJ6SULRfs Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Domain-Id: None Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Domain-Name: None Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Identity-Status: Confirmed Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Is-Admin-Project: True Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Openstack-Nova-Api-Version: 2.90 Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Project-Domain-Id: default Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Project-Domain-Name: Default Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Project-Id: a9a96491d392440daeaecef9eef8a152 Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Project-Name: admin Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Role: member,reader,admin Aug 19 15:16:44.365682 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Roles: member,reader,admin Aug 19 15:16:44.367234 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a9a96491d392440daeaecef9eef8a152", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9a96491d392440daeaecef9eef8a152"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9a96491d392440daeaecef9eef8a152"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a9a96491d392440daeaecef9eef8a152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:16:44.367234 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Tenant: admin Aug 19 15:16:44.367234 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Tenant-Id: a9a96491d392440daeaecef9eef8a152 Aug 19 15:16:44.367234 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-Tenant-Name: admin Aug 19 15:16:44.367234 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-User: admin Aug 19 15:16:44.367234 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-User-Domain-Id: default Aug 19 15:16:44.367234 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-User-Domain-Name: Default Aug 19 15:16:44.367234 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-User-Id: 0ba95fb65871415ca38c574ddd6396b8 Aug 19 15:16:44.367234 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: X-User-Name: admin Aug 19 15:16:44.367234 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: method: > Aug 19 15:16:44.367234 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: exception: Flavor 451 could not be found. Aug 19 15:16:44.367234 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: action_args: {'id': '451'} Aug 19 15:16:44.367234 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:16:44.367234 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:16:44.368118 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:16:44.369223 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:16:44.369223 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:16:44.369223 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:16:44.369223 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:16:44.369223 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 19 15:16:44.369223 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:16:44.369223 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 19 15:16:44.369223 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 19 15:16:44.369223 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:16:44.369223 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 19 15:16:44.369223 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:16:44.369223 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:16:44.369223 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:16:44.369223 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:16:44.369223 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:16:44.369223 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 19 15:16:44.369223 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Aug 19 15:16:44.369223 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-faae25a9-b9b7-425b-9505-9e29586dd1c7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:16:44.370448 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-faae25a9-b9b7-425b-9505-9e29586dd1c7 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012078 Aug 19 15:16:44.370448 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 26/52] 10.222.0.75 () {60 vars in 1193 bytes} [Fri Aug 19 15:16:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 19 15:16:45.342927 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-d96f8bf3-b26d-4791-8623-8615f782bfd4 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:45.344026 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-d96f8bf3-b26d-4791-8623-8615f782bfd4 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 19 15:16:45.344489 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 27/53] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Aug 19 15:16:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:16:45.884236 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-1bd44467-0b4d-422c-adb4-c407657bee3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:16:45.905043 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-1bd44467-0b4d-422c-adb4-c407657bee3a admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.420269 Aug 19 15:16:45.905556 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 27/54] 10.222.0.75 () {64 vars in 1235 bytes} [Fri Aug 19 15:16:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 15:16:46.869947 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-d96f8bf3-b26d-4791-8623-8615f782bfd4 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:46.870979 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-d96f8bf3-b26d-4791-8623-8615f782bfd4 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 19 15:16:46.871385 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 28/55] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Aug 19 15:16:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:16:47.405841 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-930d06de-88f8-42f3-a228-6afcd805309b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:16:47.424589 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-930d06de-88f8-42f3-a228-6afcd805309b admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.410307 Aug 19 15:16:47.425133 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 28/56] 10.222.0.75 () {64 vars in 1235 bytes} [Fri Aug 19 15:16:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 15:16:48.410771 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-d96f8bf3-b26d-4791-8623-8615f782bfd4 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:48.411419 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-d96f8bf3-b26d-4791-8623-8615f782bfd4 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001679 Aug 19 15:16:48.411872 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 29/57] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Aug 19 15:16:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:16:48.940505 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-a0c75187-9ae8-497e-aeef-811a13549630 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:16:48.959465 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-a0c75187-9ae8-497e-aeef-811a13549630 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.404699 Aug 19 15:16:48.960005 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 29/58] 10.222.0.75 () {64 vars in 1235 bytes} [Fri Aug 19 15:16:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 15:16:49.941991 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-d96f8bf3-b26d-4791-8623-8615f782bfd4 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:49.942986 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-d96f8bf3-b26d-4791-8623-8615f782bfd4 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 19 15:16:49.943387 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 30/59] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Aug 19 15:16:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:16:50.468489 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-2bb0f6ee-70c6-42e5-9531-0ffd43392c4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:16:50.486856 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-2bb0f6ee-70c6-42e5-9531-0ffd43392c4a admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.403059 Aug 19 15:16:50.487346 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 30/60] 10.222.0.75 () {64 vars in 1235 bytes} [Fri Aug 19 15:16:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 15:16:51.471314 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-d96f8bf3-b26d-4791-8623-8615f782bfd4 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:51.472316 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-d96f8bf3-b26d-4791-8623-8615f782bfd4 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 19 15:16:51.472735 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 31/61] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Aug 19 15:16:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:16:52.000346 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-bfcd7fa8-390b-45e6-99e3-972615fe01d5 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:16:52.021174 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-bfcd7fa8-390b-45e6-99e3-972615fe01d5 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.409811 Aug 19 15:16:52.021712 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 31/62] 10.222.0.75 () {60 vars in 1202 bytes} [Fri Aug 19 15:16:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:17:46.083437 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-d96f8bf3-b26d-4791-8623-8615f782bfd4 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:17:46.084503 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-d96f8bf3-b26d-4791-8623-8615f782bfd4 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 19 15:17:46.084908 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 32/63] 10.222.0.75 () {54 vars in 931 bytes} [Fri Aug 19 15:17:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:17:46.096086 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:17:46.486534 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-cd8e9173-30b5-494d-ab0e-f6eb9fb8be94 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:17:46.508882 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-cd8e9173-30b5-494d-ab0e-f6eb9fb8be94 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.417152 Aug 19 15:17:46.509426 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 32/64] 10.222.0.75 () {60 vars in 1292 bytes} [Fri Aug 19 15:17:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 15:17:46.530495 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG dbcounter [-] [105503] Writing DB stats nova_api:SELECT=14 {{(pid=105503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:17:46.534231 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-0a8af4ee-6c04-4f8e-9583-4fbb0fd31819 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:17:46.542302 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-0a8af4ee-6c04-4f8e-9583-4fbb0fd31819 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013238 Aug 19 15:17:46.542818 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 33/65] 10.222.0.75 () {60 vars in 1283 bytes} [Fri Aug 19 15:17:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:17:46.555148 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-76ee1c5a-fe3e-419e-9936-2a0b66037650 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:17:46.563602 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-76ee1c5a-fe3e-419e-9936-2a0b66037650 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012061 Aug 19 15:17:46.564119 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 33/66] 10.222.0.75 () {60 vars in 1286 bytes} [Fri Aug 19 15:17:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:17:46.576452 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-13d1fe4c-6c41-4c80-b661-4006895b8224 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:17:46.584134 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-13d1fe4c-6c41-4c80-b661-4006895b8224 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012120 Aug 19 15:17:46.584702 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 34/67] 10.222.0.75 () {60 vars in 1286 bytes} [Fri Aug 19 15:17:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:17:46.597264 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-7fc176bf-84d1-45df-9d9f-1648801e7bca admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:17:46.604798 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-7fc176bf-84d1-45df-9d9f-1648801e7bca admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011134 Aug 19 15:17:46.605307 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 34/68] 10.222.0.75 () {60 vars in 1283 bytes} [Fri Aug 19 15:17:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:21:00.975755 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-13d1fe4c-6c41-4c80-b661-4006895b8224 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:21:00.976814 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-13d1fe4c-6c41-4c80-b661-4006895b8224 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 19 15:21:00.977227 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 35/69] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Aug 19 15:21:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:21:01.116440 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=6 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:21:01.275728 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-d92a2ac7-f141-40b3-90d1-e8641542e9b0 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:21:01.279130 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:21:01.279130 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: warnings.warn(msg) Aug 19 15:21:01.280241 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-d92a2ac7-f141-40b3-90d1-e8641542e9b0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:21:01.280767 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-d92a2ac7-f141-40b3-90d1-e8641542e9b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:21:01.281184 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-d92a2ac7-f141-40b3-90d1-e8641542e9b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:21:01.281889 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-d92a2ac7-f141-40b3-90d1-e8641542e9b0 admin admin] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:21:01.282321 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-d92a2ac7-f141-40b3-90d1-e8641542e9b0 admin admin] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:21:01.282727 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-d92a2ac7-f141-40b3-90d1-e8641542e9b0 admin admin] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:21:01.317630 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-d92a2ac7-f141-40b3-90d1-e8641542e9b0 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.202586 Aug 19 15:21:01.318189 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 35/70] 10.222.0.75 () {60 vars in 1193 bytes} [Fri Aug 19 15:21:01 2022] GET /compute/v2.1/os-services => generated 794 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 15:21:02.159554 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-13d1fe4c-6c41-4c80-b661-4006895b8224 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:21:02.160587 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-13d1fe4c-6c41-4c80-b661-4006895b8224 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 19 15:21:02.160989 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 36/71] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Aug 19 15:21:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:21:02.359562 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-8deb8a00-c3ca-42d7-b770-23c9a461ca42 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:21:02.361918 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:21:02.361918 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: warnings.warn(msg) Aug 19 15:21:02.363001 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-8deb8a00-c3ca-42d7-b770-23c9a461ca42 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:21:02.363495 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-8deb8a00-c3ca-42d7-b770-23c9a461ca42 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:21:02.363915 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-8deb8a00-c3ca-42d7-b770-23c9a461ca42 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:21:02.365543 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-8deb8a00-c3ca-42d7-b770-23c9a461ca42 admin admin] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:21:02.365993 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-8deb8a00-c3ca-42d7-b770-23c9a461ca42 admin admin] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:21:02.366423 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-8deb8a00-c3ca-42d7-b770-23c9a461ca42 admin admin] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:21:02.387860 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-8deb8a00-c3ca-42d7-b770-23c9a461ca42 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.083058 Aug 19 15:21:02.388358 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 36/72] 10.222.0.75 () {60 vars in 1193 bytes} [Fri Aug 19 15:21:02 2022] GET /compute/v2.1/os-services => generated 794 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 15:21:13.645064 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-13d1fe4c-6c41-4c80-b661-4006895b8224 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:21:13.646057 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-13d1fe4c-6c41-4c80-b661-4006895b8224 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 19 15:21:13.646454 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 37/73] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Aug 19 15:21:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:21:13.794837 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_cell0:SELECT=4 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:21:13.795559 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_cell1:SELECT=4 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:21:13.796177 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=8 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:21:13.844442 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-9a7e9da9-ac47-46fa-9ad2-540c6ec9a072 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:21:13.846863 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:21:13.846863 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: warnings.warn(msg) Aug 19 15:21:13.847998 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-9a7e9da9-ac47-46fa-9ad2-540c6ec9a072 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:21:13.848522 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-9a7e9da9-ac47-46fa-9ad2-540c6ec9a072 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:21:13.848968 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-9a7e9da9-ac47-46fa-9ad2-540c6ec9a072 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:21:13.849696 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-9a7e9da9-ac47-46fa-9ad2-540c6ec9a072 admin admin] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:21:13.850128 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-9a7e9da9-ac47-46fa-9ad2-540c6ec9a072 admin admin] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:21:13.850534 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-9a7e9da9-ac47-46fa-9ad2-540c6ec9a072 admin admin] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:21:13.876828 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-9a7e9da9-ac47-46fa-9ad2-540c6ec9a072 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.087043 Aug 19 15:21:13.877379 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 37/74] 10.222.0.75 () {60 vars in 1193 bytes} [Fri Aug 19 15:21:13 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:21:14.710323 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: DEBUG nova.api.openstack.wsgi [None req-13d1fe4c-6c41-4c80-b661-4006895b8224 admin admin] Calling method '>' {{(pid=105503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:21:14.711323 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: INFO nova.api.openstack.requestlog [None req-13d1fe4c-6c41-4c80-b661-4006895b8224 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 19 15:21:14.711719 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: [pid: 105503|app: 0|req: 38/75] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Aug 19 15:21:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:21:14.907756 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-67d9ad3a-9369-4514-b102-2cd7109c07ca admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:21:14.910278 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:21:14.910278 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: warnings.warn(msg) Aug 19 15:21:14.911358 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-67d9ad3a-9369-4514-b102-2cd7109c07ca admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:21:14.911818 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-67d9ad3a-9369-4514-b102-2cd7109c07ca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:21:14.912597 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-67d9ad3a-9369-4514-b102-2cd7109c07ca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:21:14.913300 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-67d9ad3a-9369-4514-b102-2cd7109c07ca admin admin] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:21:14.913733 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-67d9ad3a-9369-4514-b102-2cd7109c07ca admin admin] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:21:14.914139 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-67d9ad3a-9369-4514-b102-2cd7109c07ca admin admin] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:21:14.937021 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-67d9ad3a-9369-4514-b102-2cd7109c07ca admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080791 Aug 19 15:21:14.937509 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 38/76] 10.222.0.75 () {60 vars in 1193 bytes} [Fri Aug 19 15:21:14 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:22:14.184170 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: Fri Aug 19 15:22:14 2022 - graceful shutdown triggered... Aug 19 15:22:14.184869 dv-cinder-835384-20-iscsi devstack@n-api.service[105502]: Gracefully killing worker 1 (pid: 105502)... Aug 19 15:22:14.186333 dv-cinder-835384-20-iscsi devstack@n-api.service[105503]: Gracefully killing worker 2 (pid: 105503)... Aug 19 15:22:14.187331 dv-cinder-835384-20-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 19 15:22:15.185237 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: worker 1 buried after 1 seconds Aug 19 15:22:15.185237 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: worker 2 buried after 1 seconds Aug 19 15:22:15.185237 dv-cinder-835384-20-iscsi devstack@n-api.service[105501]: goodbye to uWSGI. Aug 19 15:22:15.187227 dv-cinder-835384-20-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 19 15:22:15.187938 dv-cinder-835384-20-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 19 15:22:15.190990 dv-cinder-835384-20-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 19 15:22:15.201501 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 19 15:22:15.203549 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 15:22:15 2022] *** Aug 19 15:22:15.203549 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 15:22:15.203549 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 15:22:15.203549 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: nodename: dv-cinder-835384-20-iscsi Aug 19 15:22:15.203549 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: machine: x86_64 Aug 19 15:22:15.203549 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: clock source: unix Aug 19 15:22:15.203549 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: pcre jit disabled Aug 19 15:22:15.203549 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: detected number of CPU cores: 4 Aug 19 15:22:15.203549 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: current working directory: / Aug 19 15:22:15.203549 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: detected binary path: /usr/bin/uwsgi-core Aug 19 15:22:15.204277 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: your processes number limit is 47680 Aug 19 15:22:15.204277 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: your memory page size is 4096 bytes Aug 19 15:22:15.204277 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: detected max file descriptor number: 2048 Aug 19 15:22:15.204277 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: lock engine: pthread robust mutexes Aug 19 15:22:15.204277 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: thunder lock: enabled Aug 19 15:22:15.204277 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 19 15:22:15.204277 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 15:22:15.247069 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: Python main interpreter initialized at 0x55b159b709c0 Aug 19 15:22:15.247069 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: python threads support enabled Aug 19 15:22:15.247069 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: your server socket listen backlog is limited to 100 connections Aug 19 15:22:15.247069 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: your mercy for graceful operations on workers is 90 seconds Aug 19 15:22:15.247548 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 15:22:15.247633 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: *** Operational MODE: preforking *** Aug 19 15:22:15.247878 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: *** uWSGI is running in multiple interpreter mode *** Aug 19 15:22:15.247878 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: spawned uWSGI master process (pid: 120619) Aug 19 15:22:15.248090 dv-cinder-835384-20-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 19 15:22:15.248700 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: spawned uWSGI worker 1 (pid: 120637, cores: 1) Aug 19 15:22:15.249050 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: spawned uWSGI worker 2 (pid: 120638, cores: 1) Aug 19 15:22:15.249199 dv-cinder-835384-20-iscsi devstack@n-api.service[120619]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 15:22:15.946370 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 19 15:22:15.954501 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 19 15:22:17.156043 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 15:22:17.156043 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: from cryptography.utils import int_from_bytes Aug 19 15:22:17.156757 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 15:22:17.156757 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: from cryptography.utils import int_from_bytes Aug 19 15:22:17.161883 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 15:22:17.161883 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: from cryptography.utils import int_from_bytes Aug 19 15:22:17.162393 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 15:22:17.162393 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: from cryptography.utils import int_from_bytes Aug 19 15:22:19.651657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 15:22:19.653056 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 15:22:19.653151 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 15:22:19.653527 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 15:22:19.653824 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 15:22:19.654225 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.654559 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.654885 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.655210 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.655551 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.655862 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.656188 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.656547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.656882 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.657146 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.657462 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.657792 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-20-iscsi {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.658120 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.658598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.658914 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.659011 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 15:22:19.659445 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 15:22:19.659518 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.659518 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.659812 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 15:22:19.659912 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.660118 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 15:22:19.660231 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.660399 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 15:22:19.660665 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.660808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.661109 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.661431 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.661751 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.662081 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.662328 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.662545 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.662763 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.662981 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.663187 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.663422 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.663925 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.664152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.664373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.664616 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.664842 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.665066 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.665283 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.665501 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-20-iscsi {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.665718 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.665977 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.666255 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.666478 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.666695 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.666954 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.667220 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-20-iscsi {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.667444 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.667638 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.667832 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.668025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.668201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.668409 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.668598 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.668745 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.668896 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.669113 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.669276 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.669436 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.669610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.669610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.669886 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.670038 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.670194 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.670194 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.670526 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.670682 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.670827 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.670988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.671181 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.671355 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.671515 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.671660 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.671804 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.671948 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.672099 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.680026 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.680251 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-20-iscsi {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.680444 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.683350 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.684230 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.684454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.684630 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.684784 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.684940 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.685096 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.685258 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.685416 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.685561 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.685706 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.685858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.686023 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.686231 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.686400 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.686553 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.686553 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.686862 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.687090 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.687249 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.687401 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.687553 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.687698 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.687854 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.688503 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.688686 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.688834 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.688987 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.689132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.691737 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.691923 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.692090 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.692250 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.692443 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.692602 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.692789 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.692939 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.693096 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.693265 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.693412 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.693571 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.693718 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.693870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.694014 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.694167 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.694318 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.694472 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.694616 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.694616 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.694894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.695059 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.695215 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.695374 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.695530 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.695675 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.695831 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.695987 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.696190 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.696347 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.696577 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.696795 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.696962 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.697120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.697279 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.697437 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.697589 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.697743 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.697888 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.698038 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.698195 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.698349 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.698494 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.698768 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.699445 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.699608 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.699773 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.699927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.700079 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.700235 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.700501 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.700501 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.701622 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.701921 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.702087 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.702242 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.702497 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.702674 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.702835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.702988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.703134 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.703286 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.703431 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.703589 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.703743 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.703896 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.703896 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.704178 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.704321 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.704321 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.704645 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.704801 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.704801 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.705092 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.705249 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.705404 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.705557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.705557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.705837 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.705992 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.705992 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.706330 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.706478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.706478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.706771 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.706915 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.707068 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.707222 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.707222 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.707513 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.707658 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.707801 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.707951 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.707951 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.708537 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.708694 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.708694 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.708986 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.709139 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.709283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.709546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.709546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.709879 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.710034 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.710034 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.710315 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.710472 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.710472 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.711624 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.711799 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.711799 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.712264 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.712444 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.712444 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.712734 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.712880 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.713031 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.713177 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.713177 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.713471 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.713626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.713626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.713928 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.714081 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.714081 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.714364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.714625 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.715383 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.715606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.715606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.716045 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.716274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.716274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.716686 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.716832 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.717002 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.717150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.717295 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.717438 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.717631 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.717782 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.717951 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.718098 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.718250 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.718408 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.718562 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.718706 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.718847 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.719011 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.719157 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.719309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.719462 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.719605 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.719747 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.719897 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.720049 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.720204 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.720350 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.720533 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.720689 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.720853 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.721914 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.722228 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.722387 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.722542 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.722696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.722841 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.723072 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.723220 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.723376 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.723523 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.723674 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.723829 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.723999 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.724152 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.724303 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.724497 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.724650 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.724804 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.724948 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.725092 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.725243 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.725389 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.725532 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.725693 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.725852 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.726012 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.728778 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.728957 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.729114 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.729289 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.730041 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.730338 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.730570 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.730779 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.730934 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.731215 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.732093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.732253 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.732674 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.732824 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.732969 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:22:19.733114 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.733267 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.733413 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.733645 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.733814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.734002 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.734226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.734393 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.734587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.734788 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.734985 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.735189 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.735379 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.735553 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.735740 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.735929 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.736088 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.736234 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.736406 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.736559 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.736716 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.736869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.737027 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.737181 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.737503 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.737655 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.737807 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.737952 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.738096 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.738256 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.738410 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.738727 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.738936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.739111 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.739260 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.739434 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.739590 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.739742 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.739895 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.740041 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.740041 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.740338 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.740518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.740674 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.740826 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.740826 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.741102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.741507 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.741507 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.742381 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.742679 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.742851 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.743007 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.743007 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.743852 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.744008 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.744008 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.744293 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.744478 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.744641 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.744800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.744800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.745075 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.745226 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.745226 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.745519 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.745664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.745865 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.746020 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.746020 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.746306 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.746491 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.746491 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.746786 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.746931 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.746931 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.747229 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.747440 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.747599 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.747752 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.747752 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.748035 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.748179 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.748179 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.748557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.748892 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.748892 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.749210 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.749356 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.749356 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.749637 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.749783 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.749783 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.750069 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.750220 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.750365 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.750508 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.750508 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.751428 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.751840 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.751840 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.752598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.752766 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.752766 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.753330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.753486 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.753486 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.753868 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.754019 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.754172 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.754327 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.754327 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.754632 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.754777 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.754929 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.755075 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.755228 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.755379 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.755523 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.755666 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.755828 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.755974 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.756133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.756287 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.756472 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.756623 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.756623 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.756959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.757127 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.757281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.757426 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.757578 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.757723 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.757957 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.758107 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.758107 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.758401 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.758547 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.758547 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.759019 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.759174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.759328 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.759480 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.759480 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.759776 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.759931 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.759931 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.760222 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.760374 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.760374 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.760710 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.760863 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.761015 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.761168 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.761168 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.762614 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.762781 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.762781 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.763086 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.763462 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.763462 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.763757 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.763929 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.763929 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.764207 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.764363 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.764614 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.764769 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.764769 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.765067 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.765217 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.765217 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.766083 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.766258 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.766258 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.766565 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.766723 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.766723 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.767010 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.767169 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.767169 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.767466 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.767616 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.767766 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.767921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.767921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.768225 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.768377 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.768377 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.768715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.768930 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.769207 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.769375 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.769375 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.769674 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.769833 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.769833 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.770138 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.770298 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.770298 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.770602 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.770755 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.770755 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.770985 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.771072 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.771164 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.771255 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.771255 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.771427 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.771519 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.771611 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.771703 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.771795 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.771886 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.772039 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.772769 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.772903 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.773017 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.773128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.773252 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.773406 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.773764 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.773889 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.774010 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.774131 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.774252 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.774372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.774492 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.774613 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.774727 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.774837 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.774962 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.775089 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.775209 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.775320 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.775436 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.775547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.775677 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.775803 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.775918 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.775918 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.776140 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.776251 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.776369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.776369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.776662 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.776662 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.776871 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.776871 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.777661 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.777775 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.777884 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.778002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.778115 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.778115 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.778338 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.778448 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.778566 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.778685 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.778797 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.778973 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.779095 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.779228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.779447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.779565 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.779691 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.779812 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.779924 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.780042 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.780162 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.780274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.780411 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.780543 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.780665 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.780921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.781070 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.781186 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.781306 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.781417 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.781535 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.781682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.781802 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.781921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.782047 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.782160 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.782492 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.783002 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.783130 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.783250 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.783377 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.783498 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.783498 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.783969 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.784100 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.784227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.784349 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.784486 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.784611 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.784735 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.784856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.784977 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.785097 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.785210 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.785320 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.785432 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.785542 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.785668 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.785785 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.785904 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.786015 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.786125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.786242 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.786242 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.786465 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.786582 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.786693 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.786808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.786808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.787135 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.787251 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.787251 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.787458 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.787579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.787579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.787808 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.787927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.787927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.788153 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.788271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.788271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.788271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.788271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.788271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.788271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.788271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.789453 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.789672 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.789792 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.789911 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.790032 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.790157 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.790277 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.790399 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.790520 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.790639 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.790751 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.790875 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.790988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.791106 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.791224 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.791336 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.791452 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.791573 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.791685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.791795 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.791905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.792148 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.792277 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.792423 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.793715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.793870 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.794132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.794345 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.794473 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.794603 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.794717 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.794837 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.794964 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.794964 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.795173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.795292 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.795404 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.795515 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.795642 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.795760 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.795881 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.795881 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.796107 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.796233 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.796346 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.796556 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.796679 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.796789 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.796789 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.797024 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.797138 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.797248 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.797367 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.797487 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.797599 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.797719 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.797840 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.797960 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.798071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.798071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.798276 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.798401 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.798532 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.798652 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.798652 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.798877 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.798996 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.798996 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.799273 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.799387 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.799387 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.799612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.799839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.799839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.800055 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.800165 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.800165 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.800409 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.800541 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.800665 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.800775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.800775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.800993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.801105 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.801105 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.801321 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.801431 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.801601 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.801763 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.801897 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.802010 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.802121 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.802232 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.802357 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.802478 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.802617 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.803338 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.803472 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.803587 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.803587 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.803808 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.803927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.804047 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.804358 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.804729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.804854 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.805035 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.805201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.805376 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.805559 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.805766 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.805970 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.806146 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.806317 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.806489 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.806489 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.806841 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.807020 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.807209 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.807397 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.807576 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.807576 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.808001 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.808220 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.808443 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.808649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.808844 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.809043 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.809632 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.810100 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.810282 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.810469 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.810658 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.810861 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.811037 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.811217 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.811442 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.811608 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.811775 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.811949 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.812114 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.812290 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.812502 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.812687 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.812687 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.813826 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.814029 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.814029 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.814433 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.814943 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.815161 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.815368 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.815368 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.815758 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.815954 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.815954 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.816310 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.816532 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.816532 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.816908 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.817101 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.817101 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.817466 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.817642 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.817642 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.818000 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.818172 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.818360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.818650 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.818650 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.819738 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.819888 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.819888 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.820265 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.820429 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.820429 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.820685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.820797 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.820797 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.821013 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.821126 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.821237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.821355 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.821355 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.821564 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.821689 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.821802 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.821921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.822044 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.822165 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.822278 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.822403 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.822516 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.822628 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.822746 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.822866 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.822991 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.823104 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.823447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.825334 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.825517 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.825796 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.825942 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.826059 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.826187 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.826314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.826428 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.826540 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.826706 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.826886 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.827018 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.827142 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.828019 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.828148 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.828270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.828455 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.828661 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.828837 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.829017 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.829517 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.829760 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.829931 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.830131 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.830334 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.830659 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.830840 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.831018 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.831215 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.831423 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.831610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.831788 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.831980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.832187 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.832382 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.832681 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.832870 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.833060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.833232 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.834129 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.834325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.834500 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.834710 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.835034 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.835240 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.835601 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.835833 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.836184 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.836379 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.836604 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.836816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.837017 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.837224 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.837224 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.837807 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.837807 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.838174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.838374 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.838554 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.838733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.838908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.839090 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.839284 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.840187 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.840441 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.840812 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.840994 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.841189 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.841373 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.841561 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.842029 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.842196 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.842339 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.842488 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.842631 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.842793 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.842906 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.842906 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.843066 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.843151 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.843247 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.843334 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.843334 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.843542 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.843699 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.843699 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.843872 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.844288 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.844417 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.844523 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.844523 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.844756 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.844884 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.844884 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.845241 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.845355 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.845355 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.845582 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.846039 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.846347 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.846498 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.846498 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.846751 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.846899 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.846899 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.847152 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.847307 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.847307 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.847481 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.847613 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.847613 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.847819 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.847949 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.847949 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.848200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.848351 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.848496 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.848638 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.848638 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.848800 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.848893 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.848988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.849091 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.849178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.849263 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.849348 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.849441 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.849533 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.849617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.849710 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.849796 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.849880 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.849974 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.850068 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.850153 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.850302 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.850401 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.850487 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.850594 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.850683 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.850789 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.850878 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.850970 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.851069 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.851164 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.851251 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.851335 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.851427 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.851513 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.851611 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.851698 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.851790 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.851883 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.851883 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.852039 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.852132 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.852219 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.852310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.852438 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.852539 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.852635 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.852730 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.852826 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.852925 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.853012 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.853105 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.853198 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.853284 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.853375 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.853460 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.853544 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.853636 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.853723 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.853808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.853882 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.854129 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.854385 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.854492 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.854589 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.854676 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.854761 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.854845 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.854929 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.855026 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.855156 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.855243 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.855328 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.855413 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.855506 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.855592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.855685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.855771 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.856053 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.856155 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.856261 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.856372 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.856545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.856647 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.856743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.856837 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.856974 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.857069 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.857164 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.857273 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.857362 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.857456 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.857551 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.857644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.857739 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.857835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.857923 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.858017 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.858104 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.858188 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.858272 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.858364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.858459 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.858546 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.858640 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.858726 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.858800 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.859555 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.859657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.859805 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.859905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.860000 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.860087 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.860173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.860258 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.860475 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.860570 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.860669 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.860758 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.860843 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.860938 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.861031 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.861118 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.861202 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.861286 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.861378 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.861478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.861565 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.861649 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.861723 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.861808 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.861889 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.861972 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.862046 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.862118 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.862196 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.862269 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.862350 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.862431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.862504 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.862576 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.862646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.862768 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.862875 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.862952 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.863023 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.863116 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.863190 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.863263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.863346 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.863420 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.863491 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.863569 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.863642 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.863713 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.863797 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.863870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.863949 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.864022 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.864124 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.864201 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.864288 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.864558 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.864558 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.864715 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.864795 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.864883 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.864958 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.865029 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.865109 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.865188 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.865262 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.865345 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.865426 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.865498 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.865569 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.865647 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.865720 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.865813 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.865888 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.865977 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.866254 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.866355 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.866447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.866523 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.866596 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.866675 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.866754 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.866833 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.866919 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.867001 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.867075 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.867147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.867218 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.867304 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.867393 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.867474 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.867554 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.867627 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.867699 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.867778 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.867859 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.867932 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.868006 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.868077 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.868148 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.868232 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.868314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.868490 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.868572 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.868646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.868717 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.868807 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.868883 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.868954 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.869025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.869096 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.869214 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.869297 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.869377 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.869457 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.869531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.869603 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.869688 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.869762 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.869835 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.869905 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.869987 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.870067 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.870153 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.870226 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.870298 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.870368 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.870508 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.870604 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.871215 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.871299 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.871380 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.871454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.871526 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.871606 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.871686 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.871686 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.871817 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.871889 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.871959 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.872039 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.872120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.872200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.872273 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.872344 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.872344 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.872344 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.872344 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.872631 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.872710 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.872790 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.872877 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.872956 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.873036 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.873117 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.873192 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.873271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.873421 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.873497 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.873568 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.873651 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.873731 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.873804 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.873889 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.873962 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.874041 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.874122 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.874195 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.874272 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.874272 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.874272 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.874272 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.874750 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.874847 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.874933 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.875105 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.875197 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.875499 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.875589 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.875798 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.875889 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.876123 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.876236 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.876563 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.876663 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.876802 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.876900 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.877137 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.877227 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.877468 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.877555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.877779 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.877865 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.878102 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.878184 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.878446 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.878543 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.878780 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.878878 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.879494 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.879591 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.879837 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.880136 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.884435 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.887713 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.887845 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.887930 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.887930 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.887930 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.888334 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.888707 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.888804 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.888964 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.889112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.889112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.889409 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.889488 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.889600 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.889708 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.889817 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.889960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.889960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.890220 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.890328 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.890418 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.890508 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.890717 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.890870 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.891024 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.891122 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.891198 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.891288 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.891371 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.891503 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.891647 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.891756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.891856 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.891953 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.892079 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.892233 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.892352 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.892461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.892461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.892747 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.892850 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.892945 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.892945 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.893085 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.893182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.893277 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.893395 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.893561 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.893561 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.893768 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.893768 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.893957 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.894088 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.894218 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.894367 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.894473 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.894604 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.894736 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.894817 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.894902 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.895042 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.895042 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.895324 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.895439 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.895576 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.895670 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.895761 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.895889 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.896007 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.896162 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.896319 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.897453 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.897874 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.898044 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.898184 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.898355 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.898494 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.898597 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.898950 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.899054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.899179 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.899306 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.899451 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.899591 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.899690 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.899824 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.899916 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.900302 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.900452 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.900556 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.900755 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.900873 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.900969 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.901059 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.901209 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.901322 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.901436 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.901545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.901716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.901824 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.901913 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.902104 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.902266 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.902422 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.902578 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.902730 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.902887 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.903067 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.903067 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.903354 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.903472 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.903613 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.903769 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.903918 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.904073 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.904224 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.904338 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.904500 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.904703 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.904910 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.905131 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.905296 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.905470 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.905641 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.905641 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.905972 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.906078 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.906175 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.906312 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.906445 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.906595 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.906697 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.906829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.906921 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.907051 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.907179 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.907311 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.907480 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.907624 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.908038 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.908038 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.908194 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.908194 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.908420 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.908512 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.908598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.908697 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.908859 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.909265 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.909428 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.909541 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.909640 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.909728 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.909828 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.909971 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.910098 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.910589 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.910722 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.910905 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.911049 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.911145 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.911232 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.911306 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.911391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.911472 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.911816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.912134 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.912299 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.912527 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.912829 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.912969 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.913217 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.913326 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.913798 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.914064 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.914170 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.914419 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.914607 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.914790 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.915040 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.915149 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.915479 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.915738 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.915872 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.915962 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.916109 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.916373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.916558 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.916743 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.916878 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.917073 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.917514 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.917637 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.917724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.917868 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.918162 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.918291 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.918515 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.918715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.918838 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.919150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.919289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.919502 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.919690 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.919858 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.920036 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.920275 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.920513 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.920736 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.921006 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.921132 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.921395 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.921621 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.921873 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.922011 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.922424 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.922543 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.922796 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.923117 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.923280 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.923448 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.923615 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.923777 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.924085 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.924246 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.924425 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.924748 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.924856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.925130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.925233 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.925554 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.925769 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.925871 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.926183 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.926316 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.926500 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.926818 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.926917 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.927261 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.927369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.927614 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.927918 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.928221 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.928433 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.928956 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.929064 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.929485 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.929745 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.930045 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.930148 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.930558 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.930659 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.930921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.931102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.931269 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.931572 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.931670 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.932016 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.932136 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.932406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.932639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.932928 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.933034 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.933980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.934157 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.934275 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.934519 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.934718 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.935046 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.935162 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.935522 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.935613 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.935931 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.936032 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.936338 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.936552 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.936819 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.936963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.937194 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.937315 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.937762 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.937926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.938189 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.938604 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.938604 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.938858 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.938954 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.939035 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.939411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.939514 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.939834 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.939948 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.940218 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.940321 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.940615 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.940753 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.941283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.941704 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.941970 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 15:22:19.942340 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.942340 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.942340 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.942728 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.942728 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.942989 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.943363 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.943744 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.944038 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.944440 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.944743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.945115 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.945433 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.945802 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.946180 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.946588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.946920 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.947189 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.947590 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.947974 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.948326 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.949585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.949782 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.950199 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.950609 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.954102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.954102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.954102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.954102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.954102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.954102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.954102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.954102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.955137 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.955137 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.955137 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.955137 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.955632 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.955632 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.956020 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.956561 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.956823 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.957109 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.957439 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.957825 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.958150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.958550 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.958923 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.959245 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.959611 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.959941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.960311 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.960659 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.961064 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.961445 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.961787 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.962125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.962448 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.962879 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.963267 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.963705 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.964110 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.966911 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.966911 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.966911 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.966911 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.966911 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:22:19.966911 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 15:22:20.009748 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO dbcounter [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] Registered counter for database nova_api Aug 19 15:22:20.030280 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO dbcounter [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] Registered counter for database nova_api Aug 19 15:22:20.032576 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_db.sqlalchemy.engines [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:22:20.039684 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writer thread running {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:22:20.051775 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_db.sqlalchemy.engines [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:22:20.058967 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writer thread running {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:22:20.098437 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.context [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0(cell1) {{(pid=120637) load_cells /opt/stack/nova/nova/context.py:464}} Aug 19 15:22:20.102601 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:22:20.103088 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:22:20.104705 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:22:20.106069 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:22:20.106524 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:22:20.108589 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:22:20.110740 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO dbcounter [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] Registered counter for database nova_cell0 Aug 19 15:22:20.115429 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO dbcounter [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] Registered counter for database nova_cell1 Aug 19 15:22:20.118610 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.context [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0(cell1) {{(pid=120638) load_cells /opt/stack/nova/nova/context.py:464}} Aug 19 15:22:20.123639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:22:20.123874 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_db.sqlalchemy.engines [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:22:20.124131 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:22:20.125669 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_db.sqlalchemy.engines [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:22:20.125793 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:22:20.126582 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:22:20.127032 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:22:20.129075 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:22:20.131168 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO dbcounter [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] Registered counter for database nova_cell0 Aug 19 15:22:20.131412 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writer thread running {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:22:20.134136 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writer thread running {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:22:20.135391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO dbcounter [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] Registered counter for database nova_cell1 Aug 19 15:22:20.147167 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_db.sqlalchemy.engines [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:22:20.147167 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_db.sqlalchemy.engines [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:22:20.151308 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writer thread running {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:22:20.158576 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writer thread running {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:22:20.289287 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO dbcounter [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] Registered counter for database nova_cell0 Aug 19 15:22:20.296608 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_db.sqlalchemy.engines [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:22:20.301335 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writer thread running {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:22:20.311609 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO dbcounter [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] Registered counter for database nova_cell0 Aug 19 15:22:20.322007 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_db.sqlalchemy.engines [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:22:20.327433 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writer thread running {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:22:20.636012 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: WARNING keystonemiddleware.auth_token [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 15:22:20.644328 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: WARNING keystonemiddleware.auth_token [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 15:22:20.651882 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: WARNING keystonemiddleware.auth_token [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 15:22:20.659497 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: WARNING keystonemiddleware.auth_token [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 15:22:21.001244 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: WARNING keystonemiddleware.auth_token [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 15:22:21.007379 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: WARNING keystonemiddleware.auth_token [None req-522b0d02-aa26-46c9-a68f-ed8b356bd6b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 15:22:21.009999 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: WARNING keystonemiddleware.auth_token [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 15:22:21.013360 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b159b709c0 pid: 120637 (default app) Aug 19 15:22:21.016954 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: WARNING keystonemiddleware.auth_token [None req-b97ae3d6-5494-428f-b704-49086cb66c8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 15:22:21.022466 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b159b709c0 pid: 120638 (default app) Aug 19 15:22:58.581033 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:58.583114 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:58.586556 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:58.587580 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:59.981297 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18bf5016-d69c-4b27-8625-de16f01e82e1 tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] Action: 'create', calling method: .version_select at 0x7fb5393785e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1872462359", "metadata": {"Type": "work"}}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18bf5016-d69c-4b27-8625-de16f01e82e1 tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] Request method failure captured: Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 122 Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6rSM332oWblDg0wAZOq5aVrqqmvETi3KtJ0te4oMA1jtUyDY0lcWqYHcvGZ_JjLxlDPm9NFpeABYCGPGUT9rMvXjiFufNnLGfm1HS5EK3Q8WBnqTuYx3Rtva7J5ylp2-CPNvVJpa4KGgwP2bthtS6g1DxPKkHIlbQkCF5UNGY8BoLM Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: cbf73a31fbca41fd91cc218e11ccd2bb Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesNegativeTest-1957711353 Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:22:59.988696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:22:59.990308 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf73a31fbca41fd91cc218e11ccd2bb", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf73a31fbca41fd91cc218e11ccd2bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf73a31fbca41fd91cc218e11ccd2bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf73a31fbca41fd91cc218e11ccd2bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:22:59.990308 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesNegativeTest-1957711353 Aug 19 15:22:59.990308 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: cbf73a31fbca41fd91cc218e11ccd2bb Aug 19 15:22:59.990308 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesNegativeTest-1957711353 Aug 19 15:22:59.990308 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesNegativeTest-1957711353-project Aug 19 15:22:59.990308 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:22:59.990308 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:22:59.990308 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: b23f7d87039141e4ae29348d2fff2d36 Aug 19 15:22:59.990308 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesNegativeTest-1957711353-project Aug 19 15:22:59.990308 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Aug 19 15:22:59.990308 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1872462359", "metadata": {"Type": "work"}}} Aug 19 15:22:59.990308 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: Aug 19 15:22:59.990308 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1872462359', 'metadata': {'Type': 'work'}}}} Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise error Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi '#$%' Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:22:59.991112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 19 15:22:59.992700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 19 15:22:59.993860 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 19 15:22:59.993860 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:22:59.994904 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18bf5016-d69c-4b27-8625-de16f01e82e1 tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:22:59.996821 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-18bf5016-d69c-4b27-8625-de16f01e82e1 tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.432826 Aug 19 15:23:00.016678 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1/1] 10.222.0.75 () {60 vars in 1156 bytes} [Fri Aug 19 15:22:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1454 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 19 15:23:00.238941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5cf5a55c-8d5a-4a38-83ca-3ff3bc903231 tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] Action: 'create', calling method: .version_select at 0x7fb5394a7160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-246420729", "metadata": {"Type": "work"}}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5cf5a55c-8d5a-4a38-83ca-3ff3bc903231 tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] Request method failure captured: Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 119 Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6rSM332oWblDg0wAZOq5aVrqqmvETi3KtJ0te4oMA1jtUyDY0lcWqYHcvGZ_JjLxlDPm9NFpeABYCGPGUT9rMvXjiFufNnLGfm1HS5EK3Q8WBnqTuYx3Rtva7J5ylp2-CPNvVJpa4KGgwP2bthtS6g1DxPKkHIlbQkCF5UNGY8BoLM Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: cbf73a31fbca41fd91cc218e11ccd2bb Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesNegativeTest-1957711353 Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:23:00.247343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:23:00.249135 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf73a31fbca41fd91cc218e11ccd2bb", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf73a31fbca41fd91cc218e11ccd2bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf73a31fbca41fd91cc218e11ccd2bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf73a31fbca41fd91cc218e11ccd2bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:23:00.249135 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesNegativeTest-1957711353 Aug 19 15:23:00.249135 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: cbf73a31fbca41fd91cc218e11ccd2bb Aug 19 15:23:00.249135 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesNegativeTest-1957711353 Aug 19 15:23:00.249135 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesNegativeTest-1957711353-project Aug 19 15:23:00.249135 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:23:00.249135 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:23:00.249135 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: b23f7d87039141e4ae29348d2fff2d36 Aug 19 15:23:00.249135 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesNegativeTest-1957711353-project Aug 19 15:23:00.249135 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Aug 19 15:23:00.249135 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-246420729", "metadata": {"Type": "work"}}} Aug 19 15:23:00.249135 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: Aug 19 15:23:00.249135 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-246420729', 'metadata': {'Type': 'work'}}}} Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise error Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi '0' Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:23:00.250078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 19 15:23:00.251606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 19 15:23:00.253599 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 19 15:23:00.253599 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.263358 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5cf5a55c-8d5a-4a38-83ca-3ff3bc903231 tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:23:00.264664 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5cf5a55c-8d5a-4a38-83ca-3ff3bc903231 tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.260445 Aug 19 15:23:00.265413 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1/2] 10.222.0.75 () {60 vars in 1156 bytes} [Fri Aug 19 15:23:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 263 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 19 15:23:00.277213 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-40c6d27b-4f95-4739-ae07-46ed3112aac1 tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] Action: 'create', calling method: .version_select at 0x7fb539378670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2066804400", "metadata": {"Type": "work"}}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-40c6d27b-4f95-4739-ae07-46ed3112aac1 tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] Request method failure captured: Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 119 Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6rSM332oWblDg0wAZOq5aVrqqmvETi3KtJ0te4oMA1jtUyDY0lcWqYHcvGZ_JjLxlDPm9NFpeABYCGPGUT9rMvXjiFufNnLGfm1HS5EK3Q8WBnqTuYx3Rtva7J5ylp2-CPNvVJpa4KGgwP2bthtS6g1DxPKkHIlbQkCF5UNGY8BoLM Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: cbf73a31fbca41fd91cc218e11ccd2bb Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesNegativeTest-1957711353 Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:23:00.281664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:23:00.283167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf73a31fbca41fd91cc218e11ccd2bb", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf73a31fbca41fd91cc218e11ccd2bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf73a31fbca41fd91cc218e11ccd2bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf73a31fbca41fd91cc218e11ccd2bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:23:00.283167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesNegativeTest-1957711353 Aug 19 15:23:00.283167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: cbf73a31fbca41fd91cc218e11ccd2bb Aug 19 15:23:00.283167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesNegativeTest-1957711353 Aug 19 15:23:00.283167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesNegativeTest-1957711353-project Aug 19 15:23:00.283167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:23:00.283167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:23:00.283167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: b23f7d87039141e4ae29348d2fff2d36 Aug 19 15:23:00.283167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesNegativeTest-1957711353-project Aug 19 15:23:00.283167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Aug 19 15:23:00.283167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2066804400", "metadata": {"Type": "work"}}} Aug 19 15:23:00.283167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: Aug 19 15:23:00.283167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2066804400', 'metadata': {'Type': 'work'}}}} Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise error Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi '' Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:23:00.284141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 19 15:23:00.285775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 19 15:23:00.287352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 19 15:23:00.287352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.288357 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-40c6d27b-4f95-4739-ae07-46ed3112aac1 tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:23:00.289663 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-40c6d27b-4f95-4739-ae07-46ed3112aac1 tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017535 Aug 19 15:23:00.298396 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:00.300205 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:00.301312 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:00.302291 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:00.305514 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 2/3] 10.222.0.75 () {60 vars in 1156 bytes} [Fri Aug 19 15:23:00 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 19 15:23:00.310380 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d7fe65fa-f7de-4684-ba01-825b517d235b tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] Calling method '.version_select at 0x7fb539429af0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:00.923733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-d7fe65fa-f7de-4684-ba01-825b517d235b tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] HTTP exception thrown: Volume tempest-invalid-877463618 could not be found. Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d7fe65fa-f7de-4684-ba01-825b517d235b tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] Request method failure captured: Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-877463618 HTTP/1.1 Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6rSM332oWblDg0wAZOq5aVrqqmvETi3KtJ0te4oMA1jtUyDY0lcWqYHcvGZ_JjLxlDPm9NFpeABYCGPGUT9rMvXjiFufNnLGfm1HS5EK3Q8WBnqTuYx3Rtva7J5ylp2-CPNvVJpa4KGgwP2bthtS6g1DxPKkHIlbQkCF5UNGY8BoLM Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: cbf73a31fbca41fd91cc218e11ccd2bb Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesNegativeTest-1957711353 Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:23:00.928547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:23:00.930099 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf73a31fbca41fd91cc218e11ccd2bb", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf73a31fbca41fd91cc218e11ccd2bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf73a31fbca41fd91cc218e11ccd2bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf73a31fbca41fd91cc218e11ccd2bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:23:00.930099 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesNegativeTest-1957711353 Aug 19 15:23:00.930099 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: cbf73a31fbca41fd91cc218e11ccd2bb Aug 19 15:23:00.930099 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesNegativeTest-1957711353 Aug 19 15:23:00.930099 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesNegativeTest-1957711353-project Aug 19 15:23:00.930099 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:23:00.930099 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:23:00.930099 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: b23f7d87039141e4ae29348d2fff2d36 Aug 19 15:23:00.930099 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesNegativeTest-1957711353-project Aug 19 15:23:00.930099 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: Aug 19 15:23:00.930099 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Volume tempest-invalid-877463618 could not be found. Aug 19 15:23:00.930099 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': 'tempest-invalid-877463618'} Aug 19 15:23:00.930099 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-877463618 could not be found. (HTTP 404) (Request-ID: req-1e1716ed-6709-41fc-a71a-af82f5ddbe18) Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:23:00.931186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 19 15:23:00.932545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-877463618 could not be found. Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:23:00.934598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-877463618 could not be found. Aug 19 15:23:00.935959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.935959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:23:00.935959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.935959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:23:00.935959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:23:00.935959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:23:00.935959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:23:00.935959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:23:00.935959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-877463618 could not be found. Aug 19 15:23:00.935959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:00.935959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d7fe65fa-f7de-4684-ba01-825b517d235b tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] Returning 404 to user: Volume tempest-invalid-877463618 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:23:00.938585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d7fe65fa-f7de-4684-ba01-825b517d235b tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/tempest-invalid-877463618" status: 404 len: 98 microversion: 2.1 time: 0.640279 Aug 19 15:23:00.940296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 2/4] 10.222.0.75 () {58 vars in 1215 bytes} [Fri Aug 19 15:23:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-877463618 => generated 98 bytes in 644 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 19 15:23:00.947300 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ac12a388-2069-4fbd-946d-38364ffef9ba tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003860 Aug 19 15:23:00.947812 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 3/5] 10.222.0.75 () {58 vars in 1140 bytes} [Fri Aug 19 15:23:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 19 15:23:00.958147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-145dd158-1c4a-4b8e-b782-38e9bda9cf3f tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004418 Aug 19 15:23:00.959303 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 3/6] 10.222.0.75 () {58 vars in 1137 bytes} [Fri Aug 19 15:23:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 19 15:23:00.969474 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-71d4e632-a7cc-4fff-b1bd-4b4269d076e6 tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] Calling method '.version_select at 0x7fb5392b24c0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:01.224992 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-71d4e632-a7cc-4fff-b1bd-4b4269d076e6 tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] HTTP exception thrown: Volume 3e3c6303-fd9d-4a05-9667-56a4be5abf3b could not be found. Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-71d4e632-a7cc-4fff-b1bd-4b4269d076e6 tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] Request method failure captured: Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/os-volumes/3e3c6303-fd9d-4a05-9667-56a4be5abf3b HTTP/1.1 Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6rSM332oWblDg0wAZOq5aVrqqmvETi3KtJ0te4oMA1jtUyDY0lcWqYHcvGZ_JjLxlDPm9NFpeABYCGPGUT9rMvXjiFufNnLGfm1HS5EK3Q8WBnqTuYx3Rtva7J5ylp2-CPNvVJpa4KGgwP2bthtS6g1DxPKkHIlbQkCF5UNGY8BoLM Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: cbf73a31fbca41fd91cc218e11ccd2bb Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesNegativeTest-1957711353 Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:23:01.231816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:23:01.233238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf73a31fbca41fd91cc218e11ccd2bb", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf73a31fbca41fd91cc218e11ccd2bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf73a31fbca41fd91cc218e11ccd2bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf73a31fbca41fd91cc218e11ccd2bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:23:01.233238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesNegativeTest-1957711353 Aug 19 15:23:01.233238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: cbf73a31fbca41fd91cc218e11ccd2bb Aug 19 15:23:01.233238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesNegativeTest-1957711353 Aug 19 15:23:01.233238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesNegativeTest-1957711353-project Aug 19 15:23:01.233238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:23:01.233238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:23:01.233238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: b23f7d87039141e4ae29348d2fff2d36 Aug 19 15:23:01.233238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesNegativeTest-1957711353-project Aug 19 15:23:01.233238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: Aug 19 15:23:01.233238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Volume 3e3c6303-fd9d-4a05-9667-56a4be5abf3b could not be found. Aug 19 15:23:01.233238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': '3e3c6303-fd9d-4a05-9667-56a4be5abf3b'} Aug 19 15:23:01.233238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3e3c6303-fd9d-4a05-9667-56a4be5abf3b could not be found. (HTTP 404) (Request-ID: req-06e81e2c-63a8-4479-a2be-d4fdd7256db1) Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:23:01.234120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 19 15:23:01.235238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3e3c6303-fd9d-4a05-9667-56a4be5abf3b could not be found. Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 19 15:23:01.236364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:23:01.237511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3e3c6303-fd9d-4a05-9667-56a4be5abf3b could not be found. Aug 19 15:23:01.237511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:23:01.237511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:23:01.237511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:23:01.237511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:23:01.237511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:23:01.237511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:23:01.237511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:23:01.237511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:23:01.237511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3e3c6303-fd9d-4a05-9667-56a4be5abf3b could not be found. Aug 19 15:23:01.237511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:23:01.243198 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-71d4e632-a7cc-4fff-b1bd-4b4269d076e6 tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] Returning 404 to user: Volume 3e3c6303-fd9d-4a05-9667-56a4be5abf3b could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:23:01.244762 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-71d4e632-a7cc-4fff-b1bd-4b4269d076e6 tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/3e3c6303-fd9d-4a05-9667-56a4be5abf3b" status: 404 len: 109 microversion: 2.1 time: 0.280244 Aug 19 15:23:01.250373 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 4/7] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Aug 19 15:23:00 2022] DELETE /compute/v2.1/os-volumes/3e3c6303-fd9d-4a05-9667-56a4be5abf3b => generated 109 bytes in 286 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:23:01.257048 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-921e5f63-5ee5-4824-8c71-6c84ab6fab3c tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] Calling method '.version_select at 0x7fb5391da280>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:01.311464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-921e5f63-5ee5-4824-8c71-6c84ab6fab3c tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] HTTP exception thrown: Volume 059b4547-dff0-4a61-beea-b2507a2f9474 could not be found. Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-921e5f63-5ee5-4824-8c71-6c84ab6fab3c tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] Request method failure captured: Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/os-volumes/059b4547-dff0-4a61-beea-b2507a2f9474 HTTP/1.1 Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6rSM332oWblDg0wAZOq5aVrqqmvETi3KtJ0te4oMA1jtUyDY0lcWqYHcvGZ_JjLxlDPm9NFpeABYCGPGUT9rMvXjiFufNnLGfm1HS5EK3Q8WBnqTuYx3Rtva7J5ylp2-CPNvVJpa4KGgwP2bthtS6g1DxPKkHIlbQkCF5UNGY8BoLM Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: cbf73a31fbca41fd91cc218e11ccd2bb Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesNegativeTest-1957711353 Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:23:01.313860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:23:01.315156 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf73a31fbca41fd91cc218e11ccd2bb", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf73a31fbca41fd91cc218e11ccd2bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf73a31fbca41fd91cc218e11ccd2bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf73a31fbca41fd91cc218e11ccd2bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:23:01.315156 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesNegativeTest-1957711353 Aug 19 15:23:01.315156 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: cbf73a31fbca41fd91cc218e11ccd2bb Aug 19 15:23:01.315156 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesNegativeTest-1957711353 Aug 19 15:23:01.315156 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesNegativeTest-1957711353-project Aug 19 15:23:01.315156 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:23:01.315156 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:23:01.315156 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: b23f7d87039141e4ae29348d2fff2d36 Aug 19 15:23:01.315156 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesNegativeTest-1957711353-project Aug 19 15:23:01.315156 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: Aug 19 15:23:01.315156 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Volume 059b4547-dff0-4a61-beea-b2507a2f9474 could not be found. Aug 19 15:23:01.315156 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': '059b4547-dff0-4a61-beea-b2507a2f9474'} Aug 19 15:23:01.315156 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 059b4547-dff0-4a61-beea-b2507a2f9474 could not be found. (HTTP 404) (Request-ID: req-3059b738-9190-48f0-b03c-b4c06d493a5f) Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:23:01.316125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 15:23:01.317274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 059b4547-dff0-4a61-beea-b2507a2f9474 could not be found. Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 19 15:23:01.318369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:23:01.319985 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 059b4547-dff0-4a61-beea-b2507a2f9474 could not be found. Aug 19 15:23:01.319985 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:01.319985 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:23:01.319985 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:01.319985 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:23:01.319985 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:23:01.319985 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:23:01.319985 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:23:01.319985 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:23:01.319985 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 059b4547-dff0-4a61-beea-b2507a2f9474 could not be found. Aug 19 15:23:01.319985 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:23:01.321969 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-921e5f63-5ee5-4824-8c71-6c84ab6fab3c tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] Returning 404 to user: Volume 059b4547-dff0-4a61-beea-b2507a2f9474 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:23:01.322975 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-921e5f63-5ee5-4824-8c71-6c84ab6fab3c tempest-VolumesNegativeTest-1957711353 tempest-VolumesNegativeTest-1957711353-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/059b4547-dff0-4a61-beea-b2507a2f9474" status: 404 len: 109 microversion: 2.1 time: 0.071852 Aug 19 15:23:01.323818 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 4/8] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Aug 19 15:23:01 2022] GET /compute/v2.1/os-volumes/059b4547-dff0-4a61-beea-b2507a2f9474 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:23:02.990060 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-96b17430-d559-44fd-b6ff-63944b8e2828 tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] Calling method '.version_select at 0x7fb5391e40d0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:03.124937 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-96b17430-d559-44fd-b6ff-63944b8e2828 tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/05d04675-0a79-4bcc-9824-e470e615493d" status: 200 len: 351 microversion: 2.1 time: 0.139697 Aug 19 15:23:03.125988 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 5/9] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Aug 19 15:23:02 2022] GET /compute/v2.1/os-volumes/05d04675-0a79-4bcc-9824-e470e615493d => generated 351 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:23:06.191080 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-db25c856-435e-45eb-9fd8-ae3ff2cb9860 tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] Calling method '.version_select at 0x7fb539230c10>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:06.309468 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-db25c856-435e-45eb-9fd8-ae3ff2cb9860 tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/761a7349-19ed-4804-9033-3a9e66bdd93b" status: 200 len: 350 microversion: 2.1 time: 0.123129 Aug 19 15:23:06.310496 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 5/10] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Aug 19 15:23:06 2022] GET /compute/v2.1/os-volumes/761a7349-19ed-4804-9033-3a9e66bdd93b => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:23:08.548448 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3ce3cade-648d-4f16-85f6-fcc550896e32 tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] Calling method '.version_select at 0x7fb5391e4820>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:08.679586 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3ce3cade-648d-4f16-85f6-fcc550896e32 tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/92f052fe-06cd-4776-a309-aa5f62ef146d" status: 200 len: 351 microversion: 2.1 time: 0.139371 Aug 19 15:23:08.691205 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 6/11] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Aug 19 15:23:08 2022] GET /compute/v2.1/os-volumes/92f052fe-06cd-4776-a309-aa5f62ef146d => generated 351 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:23:08.695082 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d364a159-1460-40ff-a796-c4f236c5e318 tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] Calling method '.version_select at 0x7fb5391da3a0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:08.975406 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d364a159-1460-40ff-a796-c4f236c5e318 tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.283340 Aug 19 15:23:08.976562 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 6/12] 10.222.0.75 () {58 vars in 1134 bytes} [Fri Aug 19 15:23:08 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:08.990861 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fa216805-8fa2-4183-881c-10dbdf4b74d4 tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] Calling method '.version_select at 0x7fb5392b24c0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:09.236223 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fa216805-8fa2-4183-881c-10dbdf4b74d4 tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.248848 Aug 19 15:23:09.237917 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 7/13] 10.222.0.75 () {58 vars in 1149 bytes} [Fri Aug 19 15:23:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:23:09.277686 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-55d9d668-2039-44d0-8828-83d78392375f tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] Calling method '.version_select at 0x7fb5391e09d0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:09.509724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-55d9d668-2039-44d0-8828-83d78392375f tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.256255 Aug 19 15:23:09.510538 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 7/14] 10.222.0.75 () {58 vars in 1134 bytes} [Fri Aug 19 15:23:09 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:09.525801 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5716aa1d-b7d3-43db-8687-44bc689cf230 tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] Calling method '.version_select at 0x7fb5391e40d0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:09.753615 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5716aa1d-b7d3-43db-8687-44bc689cf230 tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.231337 Aug 19 15:23:09.755177 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 8/15] 10.222.0.75 () {58 vars in 1167 bytes} [Fri Aug 19 15:23:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:23:09.768797 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c0984ee2-164f-4b81-96e2-252f73bdb7e8 tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] Calling method '.version_select at 0x7fb5391e0820>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:09.999342 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c0984ee2-164f-4b81-96e2-252f73bdb7e8 tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.234315 Aug 19 15:23:10.001205 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 8/16] 10.222.0.75 () {58 vars in 1170 bytes} [Fri Aug 19 15:23:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:23:10.014545 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b995e212-c894-484e-abf9-3c019e7ff35c tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] Calling method '.version_select at 0x7fb539213dc0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:10.218057 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b995e212-c894-484e-abf9-3c019e7ff35c tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.208677 Aug 19 15:23:10.219504 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 9/17] 10.222.0.75 () {58 vars in 1155 bytes} [Fri Aug 19 15:23:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:10.233423 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5ca2dd81-7455-4a9d-bb3b-8d7fbc6211e8 tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] Calling method '.version_select at 0x7fb5391da4c0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:10.521397 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5ca2dd81-7455-4a9d-bb3b-8d7fbc6211e8 tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.283449 Aug 19 15:23:10.521397 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 9/18] 10.222.0.75 () {58 vars in 1188 bytes} [Fri Aug 19 15:23:10 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:23:10.533766 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a1d7641e-baa0-40d3-8504-6c819c615349 tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] Calling method '.version_select at 0x7fb5391e4e50>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:10.764582 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a1d7641e-baa0-40d3-8504-6c819c615349 tempest-VolumesTestJSON-49579931 tempest-VolumesTestJSON-49579931-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.236614 Aug 19 15:23:10.765675 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 10/19] 10.222.0.75 () {58 vars in 1155 bytes} [Fri Aug 19 15:23:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:12.609413 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-26c4da35-041c-4ddb-9059-d50242bb7996 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Action: 'create', calling method: .version_select at 0x7fb539252820>, body: {"keypair": {"name": "tempest-keypair-832006233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfv/ckRxhItC1WkPz/5xQY1X7oGkxyOZXXZcWls9+FmKvHQKkZ1Rf11+9PbugwMheY3CPaCWFZBMtqtktT02QR4F6UL7FceDqrciKVaLsRXcOyyNHbTFULzvBDGTdXtCw=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:23:12.772112 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-26c4da35-041c-4ddb-9059-d50242bb7996 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Getting quotas for project 8ede055158e24b7c9a935b833e33b89a. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:23:12.780614 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-26c4da35-041c-4ddb-9059-d50242bb7996 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Getting quotas for user dc2bbdceb12641e6a0595e68f7cefd63 and project 8ede055158e24b7c9a935b833e33b89a. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:23:12.889806 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-26c4da35-041c-4ddb-9059-d50242bb7996 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.613144 Aug 19 15:23:12.890790 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 10/20] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Aug 19 15:23:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:23:16.043837 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bf1fb739-191a-46dd-8eb1-6e930ddd201e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Action: 'create', calling method: .version_select at 0x7fb539331b80>, body: {"keypair": {"name": "tempest-keypair-1566286012", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHe4Z8qi8PlKWrK4nQJJ3OoOSpQSXaFUEkZP6Yi6HZP3ahgYZOpA0RTQpm932ba5gN5xbqyo6hKP0RPqGapj5qiiQOGUVzmD+KKRfTYBpJ5BXrvnsAhiijbSf2kUH0v1qw=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:23:16.248478 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-bf1fb739-191a-46dd-8eb1-6e930ddd201e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Getting quotas for project cbf14c554d854af5ba8cd910c82d42e0. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:23:16.263860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3ea19c70-3a8b-4bde-b749-42679988cfb0 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2037833925", "imageRef": "27174b76-85e7-4123-a2bc-847959ca59f2", "flavorRef": "452", "networks": [{"uuid": "8ca696a6-5a42-4e8e-bad5-e98dabe98bc6"}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:23:16.265452 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-bf1fb739-191a-46dd-8eb1-6e930ddd201e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Getting quotas for user 4aaa94a183fb49b79e6383ea783ab76d and project cbf14c554d854af5ba8cd910c82d42e0. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:23:16.415101 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bf1fb739-191a-46dd-8eb1-6e930ddd201e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.831634 Aug 19 15:23:16.424147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 11/21] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Aug 19 15:23:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:23:16.564892 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-3ea19c70-3a8b-4bde-b749-42679988cfb0 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] validate_networks() for [('8ca696a6-5a42-4e8e-bad5-e98dabe98bc6', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:23:18.484002 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a4e552b3-0eca-44a8-835e-42e5fb4660fd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-129611886", "imageRef": "27174b76-85e7-4123-a2bc-847959ca59f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:23:18.815409 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-a4e552b3-0eca-44a8-835e-42e5fb4660fd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] validate_networks() for [('767088c7-8ee1-471e-80fb-53a5e6370be0', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:23:19.194296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-3ea19c70-3a8b-4bde-b749-42679988cfb0 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:23:19.205236 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-3ea19c70-3a8b-4bde-b749-42679988cfb0 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:23:19.219369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-3ea19c70-3a8b-4bde-b749-42679988cfb0 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:23:19.221140 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-3ea19c70-3a8b-4bde-b749-42679988cfb0 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:23:19.222382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-3ea19c70-3a8b-4bde-b749-42679988cfb0 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:23:19.259025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ea19c70-3a8b-4bde-b749-42679988cfb0 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:19.260765 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ea19c70-3a8b-4bde-b749-42679988cfb0 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:19.262215 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ea19c70-3a8b-4bde-b749-42679988cfb0 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:19.263624 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ea19c70-3a8b-4bde-b749-42679988cfb0 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:19.264544 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ea19c70-3a8b-4bde-b749-42679988cfb0 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:19.265774 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ea19c70-3a8b-4bde-b749-42679988cfb0 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:19.316827 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-3ea19c70-3a8b-4bde-b749-42679988cfb0 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Getting quotas for project ea214b3e591a44928fd7af5f51095405. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:23:19.322543 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-3ea19c70-3a8b-4bde-b749-42679988cfb0 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Getting quotas for user 58fa0eb8e5ad41038d447c54bad91a6d and project ea214b3e591a44928fd7af5f51095405. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:23:19.357799 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3ea19c70-3a8b-4bde-b749-42679988cfb0 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:23:19.361772 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3ea19c70-3a8b-4bde-b749-42679988cfb0 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27174b76-85e7-4123-a2bc-847959ca59f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:23:19.622682 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3ea19c70-3a8b-4bde-b749-42679988cfb0 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.002251 Aug 19 15:23:19.627630 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 11/22] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:23:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 4008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 15:23:19.645990 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-84dc5918-bf7e-426c-9cf1-035745c839ed tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:19.646617 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-84dc5918-bf7e-426c-9cf1-035745c839ed tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:19.953145 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-84dc5918-bf7e-426c-9cf1-035745c839ed tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:19.992167 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-84dc5918-bf7e-426c-9cf1-035745c839ed tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1215 microversion: 2.1 time: 0.353676 Aug 19 15:23:20.013801 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 12/23] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:19 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1215 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:20.785363 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-a4e552b3-0eca-44a8-835e-42e5fb4660fd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:23:20.785363 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-a4e552b3-0eca-44a8-835e-42e5fb4660fd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:23:20.785363 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-a4e552b3-0eca-44a8-835e-42e5fb4660fd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:23:20.785363 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-a4e552b3-0eca-44a8-835e-42e5fb4660fd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:23:20.785363 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-a4e552b3-0eca-44a8-835e-42e5fb4660fd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:23:20.823458 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4e552b3-0eca-44a8-835e-42e5fb4660fd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:20.823718 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4e552b3-0eca-44a8-835e-42e5fb4660fd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:20.824154 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4e552b3-0eca-44a8-835e-42e5fb4660fd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:20.824919 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4e552b3-0eca-44a8-835e-42e5fb4660fd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:20.825367 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4e552b3-0eca-44a8-835e-42e5fb4660fd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:20.846477 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4e552b3-0eca-44a8-835e-42e5fb4660fd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:20.928303 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-a4e552b3-0eca-44a8-835e-42e5fb4660fd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Getting quotas for project dcca6c7d30114cd0936eb30381efad7d. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:23:20.935772 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-a4e552b3-0eca-44a8-835e-42e5fb4660fd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Getting quotas for user 218f3dd17e6549fc8796eb30e4b48e24 and project dcca6c7d30114cd0936eb30381efad7d. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:23:20.961479 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a4e552b3-0eca-44a8-835e-42e5fb4660fd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:23:20.965284 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a4e552b3-0eca-44a8-835e-42e5fb4660fd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27174b76-85e7-4123-a2bc-847959ca59f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:23:21.016853 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-192986b2-1c50-41e0-ba28-b53aaf60139d tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:21.017667 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-192986b2-1c50-41e0-ba28-b53aaf60139d tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:21.132599 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a4e552b3-0eca-44a8-835e-42e5fb4660fd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.129275 Aug 19 15:23:21.133923 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 12/24] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:23:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 3131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 19 15:23:21.150917 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-82dabb83-3167-4eaa-a2da-7c0bd12cef1b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:21.153463 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-82dabb83-3167-4eaa-a2da-7c0bd12cef1b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:21.173186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-192986b2-1c50-41e0-ba28-b53aaf60139d tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:21.184746 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-192986b2-1c50-41e0-ba28-b53aaf60139d tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1215 microversion: 2.1 time: 0.172111 Aug 19 15:23:21.204812 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 13/25] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:21 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1215 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:21.340759 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-82dabb83-3167-4eaa-a2da-7c0bd12cef1b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:21.373991 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-82dabb83-3167-4eaa-a2da-7c0bd12cef1b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1221 microversion: 2.1 time: 0.227186 Aug 19 15:23:21.376907 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 13/26] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:21 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1221 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:23:21.844460 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-308ec257-732a-4251-9b78-69c2dbc97156 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-148403298", "imageRef": "27174b76-85e7-4123-a2bc-847959ca59f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:23:21.990837 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-308ec257-732a-4251-9b78-69c2dbc97156 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] validate_networks() for [('767088c7-8ee1-471e-80fb-53a5e6370be0', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:23:22.193497 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-97310c3c-c8a3-465f-b85e-03d3fd3c4cdf tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2064463827", "imageRef": "27174b76-85e7-4123-a2bc-847959ca59f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "686c1d24-9be3-4e13-8a5a-a63e7258a1fc"}], "security_groups": [{"name": "tempest-securitygroup--1664000454"}], "key_name": "tempest-keypair-832006233", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:23:22.641298 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-97310c3c-c8a3-465f-b85e-03d3fd3c4cdf tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] validate_networks() for [('686c1d24-9be3-4e13-8a5a-a63e7258a1fc', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:23:23.625969 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-308ec257-732a-4251-9b78-69c2dbc97156 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:23:23.626477 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-308ec257-732a-4251-9b78-69c2dbc97156 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:23:23.626954 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-308ec257-732a-4251-9b78-69c2dbc97156 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:23:23.627282 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-308ec257-732a-4251-9b78-69c2dbc97156 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:23:23.627694 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-308ec257-732a-4251-9b78-69c2dbc97156 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:23:23.644637 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-308ec257-732a-4251-9b78-69c2dbc97156 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:23.645133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-308ec257-732a-4251-9b78-69c2dbc97156 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:23.645578 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-308ec257-732a-4251-9b78-69c2dbc97156 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:23.650338 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-308ec257-732a-4251-9b78-69c2dbc97156 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:23.651080 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-308ec257-732a-4251-9b78-69c2dbc97156 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:23.656801 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-308ec257-732a-4251-9b78-69c2dbc97156 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:23.727208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-308ec257-732a-4251-9b78-69c2dbc97156 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Getting quotas for project dcca6c7d30114cd0936eb30381efad7d. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:23:23.745774 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-308ec257-732a-4251-9b78-69c2dbc97156 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Getting quotas for user 218f3dd17e6549fc8796eb30e4b48e24 and project dcca6c7d30114cd0936eb30381efad7d. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:23:23.794634 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-308ec257-732a-4251-9b78-69c2dbc97156 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:23:23.813443 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-308ec257-732a-4251-9b78-69c2dbc97156 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27174b76-85e7-4123-a2bc-847959ca59f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:23:23.974375 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-308ec257-732a-4251-9b78-69c2dbc97156 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.134360 Aug 19 15:23:23.984749 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 14/27] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:23:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 2148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 15:23:23.993606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-83a92559-7ed0-44d3-b8f1-dac012fe4441 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:23.998042 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-83a92559-7ed0-44d3-b8f1-dac012fe4441 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:24.006962 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83a92559-7ed0-44d3-b8f1-dac012fe4441 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:24.007635 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83a92559-7ed0-44d3-b8f1-dac012fe4441 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:24.008212 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83a92559-7ed0-44d3-b8f1-dac012fe4441 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:24.009095 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83a92559-7ed0-44d3-b8f1-dac012fe4441 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:24.009684 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83a92559-7ed0-44d3-b8f1-dac012fe4441 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:24.010348 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83a92559-7ed0-44d3-b8f1-dac012fe4441 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:24.359574 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83a92559-7ed0-44d3-b8f1-dac012fe4441 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:24.395024 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-97310c3c-c8a3-465f-b85e-03d3fd3c4cdf tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:23:24.396811 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-97310c3c-c8a3-465f-b85e-03d3fd3c4cdf tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:23:24.397740 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-97310c3c-c8a3-465f-b85e-03d3fd3c4cdf tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:23:24.398374 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-97310c3c-c8a3-465f-b85e-03d3fd3c4cdf tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:23:24.398973 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-97310c3c-c8a3-465f-b85e-03d3fd3c4cdf tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:23:24.412640 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97310c3c-c8a3-465f-b85e-03d3fd3c4cdf tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:24.413419 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97310c3c-c8a3-465f-b85e-03d3fd3c4cdf tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:24.414135 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97310c3c-c8a3-465f-b85e-03d3fd3c4cdf tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:24.415276 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97310c3c-c8a3-465f-b85e-03d3fd3c4cdf tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:24.415875 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97310c3c-c8a3-465f-b85e-03d3fd3c4cdf tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:24.417988 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97310c3c-c8a3-465f-b85e-03d3fd3c4cdf tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:24.434011 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-83a92559-7ed0-44d3-b8f1-dac012fe4441 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1219 microversion: 2.1 time: 0.445934 Aug 19 15:23:24.434769 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 15/28] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:23 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1219 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:24.451799 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7bcc62a1-580e-4a01-93aa-a4e53392aac4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1632719336", "imageRef": "27174b76-85e7-4123-a2bc-847959ca59f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a74f9df-bea0-4bc2-8022-d4f3c9598ba3"}], "security_groups": [{"name": "tempest-securitygroup--638821910"}], "key_name": "tempest-keypair-1566286012", "user_data": "}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:23:24.501499 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-97310c3c-c8a3-465f-b85e-03d3fd3c4cdf tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Getting quotas for project 8ede055158e24b7c9a935b833e33b89a. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:23:24.517830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-97310c3c-c8a3-465f-b85e-03d3fd3c4cdf tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Getting quotas for user dc2bbdceb12641e6a0595e68f7cefd63 and project 8ede055158e24b7c9a935b833e33b89a. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:23:24.553703 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-97310c3c-c8a3-465f-b85e-03d3fd3c4cdf tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:23:24.563851 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-97310c3c-c8a3-465f-b85e-03d3fd3c4cdf tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27174b76-85e7-4123-a2bc-847959ca59f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:23:24.656715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-7bcc62a1-580e-4a01-93aa-a4e53392aac4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] validate_networks() for [('6a74f9df-bea0-4bc2-8022-d4f3c9598ba3', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:23:24.721378 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-97310c3c-c8a3-465f-b85e-03d3fd3c4cdf tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.532664 Aug 19 15:23:24.724915 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 14/29] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:23:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 2537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 15:23:24.741131 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c7012575-526e-4967-8222-27ed8b5e62d5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:24.743817 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c7012575-526e-4967-8222-27ed8b5e62d5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:24.961033 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c7012575-526e-4967-8222-27ed8b5e62d5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:25.036204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c7012575-526e-4967-8222-27ed8b5e62d5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1221 microversion: 2.1 time: 0.306320 Aug 19 15:23:25.043188 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 15/30] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:24 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1221 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:25.070221 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a2d99892-bec8-4e4a-83d2-3970751d75d4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:25.070988 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a2d99892-bec8-4e4a-83d2-3970751d75d4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:25.392511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a2d99892-bec8-4e4a-83d2-3970751d75d4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:25.399899 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a2d99892-bec8-4e4a-83d2-3970751d75d4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1237 microversion: 2.1 time: 0.355562 Aug 19 15:23:25.408572 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 16/31] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:25 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1237 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:25.456564 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-63940d8b-ce94-49be-ad57-ded21762d346 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:25.457194 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-63940d8b-ce94-49be-ad57-ded21762d346 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:25.470736 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63940d8b-ce94-49be-ad57-ded21762d346 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:25.471246 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63940d8b-ce94-49be-ad57-ded21762d346 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:25.473556 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63940d8b-ce94-49be-ad57-ded21762d346 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:25.474471 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63940d8b-ce94-49be-ad57-ded21762d346 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:25.477095 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63940d8b-ce94-49be-ad57-ded21762d346 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:25.477680 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63940d8b-ce94-49be-ad57-ded21762d346 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:26.116273 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-63940d8b-ce94-49be-ad57-ded21762d346 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:26.150361 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-63940d8b-ce94-49be-ad57-ded21762d346 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1267 microversion: 2.1 time: 0.697659 Aug 19 15:23:26.151687 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 17/32] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:25 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1267 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:23:26.162830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-17f42728-37a4-4a0e-8ba5-ac80ccd91819 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:26.163449 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-17f42728-37a4-4a0e-8ba5-ac80ccd91819 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:26.195868 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17f42728-37a4-4a0e-8ba5-ac80ccd91819 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:26.196366 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17f42728-37a4-4a0e-8ba5-ac80ccd91819 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:26.196834 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17f42728-37a4-4a0e-8ba5-ac80ccd91819 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:26.205754 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17f42728-37a4-4a0e-8ba5-ac80ccd91819 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:26.206471 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17f42728-37a4-4a0e-8ba5-ac80ccd91819 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:26.207119 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17f42728-37a4-4a0e-8ba5-ac80ccd91819 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:26.735004 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-17f42728-37a4-4a0e-8ba5-ac80ccd91819 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:26.750401 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-17f42728-37a4-4a0e-8ba5-ac80ccd91819 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1273 microversion: 2.1 time: 0.597476 Aug 19 15:23:26.754192 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 18/33] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:26 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1273 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:26.770611 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c163734d-3b04-4068-89c4-423e31744d66 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:26.773276 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c163734d-3b04-4068-89c4-423e31744d66 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:26.788842 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c163734d-3b04-4068-89c4-423e31744d66 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:26.790447 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c163734d-3b04-4068-89c4-423e31744d66 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:26.791133 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c163734d-3b04-4068-89c4-423e31744d66 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:26.793331 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c163734d-3b04-4068-89c4-423e31744d66 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:26.794310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c163734d-3b04-4068-89c4-423e31744d66 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:26.796247 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c163734d-3b04-4068-89c4-423e31744d66 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:26.878170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-7bcc62a1-580e-4a01-93aa-a4e53392aac4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:23:26.879348 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-7bcc62a1-580e-4a01-93aa-a4e53392aac4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:23:26.880084 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-7bcc62a1-580e-4a01-93aa-a4e53392aac4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:23:26.880678 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-7bcc62a1-580e-4a01-93aa-a4e53392aac4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:23:26.881234 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-7bcc62a1-580e-4a01-93aa-a4e53392aac4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:23:26.919624 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bcc62a1-580e-4a01-93aa-a4e53392aac4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:26.920125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bcc62a1-580e-4a01-93aa-a4e53392aac4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:26.920588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bcc62a1-580e-4a01-93aa-a4e53392aac4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:26.923995 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bcc62a1-580e-4a01-93aa-a4e53392aac4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:26.924661 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bcc62a1-580e-4a01-93aa-a4e53392aac4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:26.926813 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bcc62a1-580e-4a01-93aa-a4e53392aac4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:26.992910 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-7bcc62a1-580e-4a01-93aa-a4e53392aac4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Getting quotas for project cbf14c554d854af5ba8cd910c82d42e0. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:23:27.002972 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-7bcc62a1-580e-4a01-93aa-a4e53392aac4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Getting quotas for user 4aaa94a183fb49b79e6383ea783ab76d and project cbf14c554d854af5ba8cd910c82d42e0. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:23:27.054539 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7bcc62a1-580e-4a01-93aa-a4e53392aac4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:23:27.065685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7bcc62a1-580e-4a01-93aa-a4e53392aac4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27174b76-85e7-4123-a2bc-847959ca59f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:23:27.266402 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7bcc62a1-580e-4a01-93aa-a4e53392aac4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.829713 Aug 19 15:23:27.271636 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 16/34] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:23:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 2835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 15:23:27.292533 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f9132a32-b335-4156-a3be-fdb7069ded9e tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:27.296866 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f9132a32-b335-4156-a3be-fdb7069ded9e tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:27.338257 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9132a32-b335-4156-a3be-fdb7069ded9e tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:27.338831 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9132a32-b335-4156-a3be-fdb7069ded9e tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:27.342093 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9132a32-b335-4156-a3be-fdb7069ded9e tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:27.345338 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9132a32-b335-4156-a3be-fdb7069ded9e tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:27.345831 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9132a32-b335-4156-a3be-fdb7069ded9e tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:27.349038 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9132a32-b335-4156-a3be-fdb7069ded9e tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:27.766230 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f9132a32-b335-4156-a3be-fdb7069ded9e tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:27.780172 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f9132a32-b335-4156-a3be-fdb7069ded9e tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1273 microversion: 2.1 time: 0.504528 Aug 19 15:23:27.795968 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 17/35] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:27 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1273 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:27.797736 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c163734d-3b04-4068-89c4-423e31744d66 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:27.801455 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0e9b92b2-470c-48fa-b8a3-ad26f46b25f8 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:27.802082 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0e9b92b2-470c-48fa-b8a3-ad26f46b25f8 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:27.833110 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c163734d-3b04-4068-89c4-423e31744d66 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1289 microversion: 2.1 time: 1.075210 Aug 19 15:23:27.837151 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 19/36] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:26 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1289 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:27.863832 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e9b69c69-18ac-4154-b568-d096f5349afa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:27.866446 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e9b69c69-18ac-4154-b568-d096f5349afa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:27.887555 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9b69c69-18ac-4154-b568-d096f5349afa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:27.890253 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9b69c69-18ac-4154-b568-d096f5349afa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:27.892670 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9b69c69-18ac-4154-b568-d096f5349afa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:27.895179 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9b69c69-18ac-4154-b568-d096f5349afa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:27.896230 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9b69c69-18ac-4154-b568-d096f5349afa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:27.897295 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9b69c69-18ac-4154-b568-d096f5349afa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:28.117776 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0e9b92b2-470c-48fa-b8a3-ad26f46b25f8 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:28.140146 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0e9b92b2-470c-48fa-b8a3-ad26f46b25f8 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1242 microversion: 2.1 time: 0.349564 Aug 19 15:23:28.143102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 18/37] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:27 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1242 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:28.312533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e9b69c69-18ac-4154-b568-d096f5349afa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:28.320787 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e9b69c69-18ac-4154-b568-d096f5349afa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1279 microversion: 2.1 time: 0.479069 Aug 19 15:23:28.321375 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 20/38] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:27 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1279 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:28.814397 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d26602e4-d5ec-4751-a52f-b4e61c11a7a8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:28.815907 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d26602e4-d5ec-4751-a52f-b4e61c11a7a8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:28.872871 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a7005a74-9d18-4154-84a9-696b1c8afb16 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:28.874889 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a7005a74-9d18-4154-84a9-696b1c8afb16 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:28.885458 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d26602e4-d5ec-4751-a52f-b4e61c11a7a8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:28.889644 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d26602e4-d5ec-4751-a52f-b4e61c11a7a8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.048s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:28.892781 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d26602e4-d5ec-4751-a52f-b4e61c11a7a8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:28.898270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d26602e4-d5ec-4751-a52f-b4e61c11a7a8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:28.900410 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d26602e4-d5ec-4751-a52f-b4e61c11a7a8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:28.905379 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d26602e4-d5ec-4751-a52f-b4e61c11a7a8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:28.918571 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7005a74-9d18-4154-84a9-696b1c8afb16 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:28.920734 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7005a74-9d18-4154-84a9-696b1c8afb16 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:28.921355 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7005a74-9d18-4154-84a9-696b1c8afb16 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:28.928439 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7005a74-9d18-4154-84a9-696b1c8afb16 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:28.928996 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7005a74-9d18-4154-84a9-696b1c8afb16 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:28.929462 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7005a74-9d18-4154-84a9-696b1c8afb16 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:29.156551 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d26602e4-d5ec-4751-a52f-b4e61c11a7a8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:29.174822 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d26602e4-d5ec-4751-a52f-b4e61c11a7a8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1273 microversion: 2.1 time: 0.366433 Aug 19 15:23:29.175415 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 19/39] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:28 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1273 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:29.196249 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f783e733-844a-4578-b810-ce7ebf19ee22 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:29.202948 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f783e733-844a-4578-b810-ce7ebf19ee22 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:29.218944 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f783e733-844a-4578-b810-ce7ebf19ee22 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:29.230862 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f783e733-844a-4578-b810-ce7ebf19ee22 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:29.232747 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f783e733-844a-4578-b810-ce7ebf19ee22 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:29.235160 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f783e733-844a-4578-b810-ce7ebf19ee22 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:29.238350 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f783e733-844a-4578-b810-ce7ebf19ee22 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:29.239713 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f783e733-844a-4578-b810-ce7ebf19ee22 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:29.296109 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a7005a74-9d18-4154-84a9-696b1c8afb16 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:29.331238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a7005a74-9d18-4154-84a9-696b1c8afb16 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1295 microversion: 2.1 time: 0.471963 Aug 19 15:23:29.331802 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 21/40] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:28 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1295 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:23:29.359876 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c2325456-171d-4966-bab5-b8776c302f11 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:29.361176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c2325456-171d-4966-bab5-b8776c302f11 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:29.381562 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2325456-171d-4966-bab5-b8776c302f11 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:29.389816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2325456-171d-4966-bab5-b8776c302f11 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:29.390599 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2325456-171d-4966-bab5-b8776c302f11 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:29.391848 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2325456-171d-4966-bab5-b8776c302f11 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:29.392552 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2325456-171d-4966-bab5-b8776c302f11 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:29.393188 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2325456-171d-4966-bab5-b8776c302f11 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:29.977483 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f783e733-844a-4578-b810-ce7ebf19ee22 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:30.001625 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c2325456-171d-4966-bab5-b8776c302f11 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:30.003622 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f783e733-844a-4578-b810-ce7ebf19ee22 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1294 microversion: 2.1 time: 0.820695 Aug 19 15:23:30.020688 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 20/41] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:29 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1294 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:30.030691 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c2325456-171d-4966-bab5-b8776c302f11 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1279 microversion: 2.1 time: 0.685926 Aug 19 15:23:30.031980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 22/42] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:29 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1279 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:30.197072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5433af68-73eb-4ac8-86f9-9234b473b175 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:30.198408 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5433af68-73eb-4ac8-86f9-9234b473b175 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:30.217333 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5433af68-73eb-4ac8-86f9-9234b473b175 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:30.217921 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5433af68-73eb-4ac8-86f9-9234b473b175 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:30.218368 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5433af68-73eb-4ac8-86f9-9234b473b175 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:30.219493 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5433af68-73eb-4ac8-86f9-9234b473b175 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:30.219573 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5433af68-73eb-4ac8-86f9-9234b473b175 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:30.219964 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5433af68-73eb-4ac8-86f9-9234b473b175 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:30.357287 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2597bda0-d222-49c5-b15e-561d82bd1296 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:30.357915 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2597bda0-d222-49c5-b15e-561d82bd1296 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:30.369727 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2597bda0-d222-49c5-b15e-561d82bd1296 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:30.373372 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2597bda0-d222-49c5-b15e-561d82bd1296 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:30.374389 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2597bda0-d222-49c5-b15e-561d82bd1296 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:30.375953 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2597bda0-d222-49c5-b15e-561d82bd1296 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:30.378354 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2597bda0-d222-49c5-b15e-561d82bd1296 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:30.378973 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2597bda0-d222-49c5-b15e-561d82bd1296 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:30.625707 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2597bda0-d222-49c5-b15e-561d82bd1296 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:30.662040 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2597bda0-d222-49c5-b15e-561d82bd1296 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1295 microversion: 2.1 time: 0.310416 Aug 19 15:23:30.662480 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 23/43] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:30 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1295 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:23:30.698857 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5433af68-73eb-4ac8-86f9-9234b473b175 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:30.727069 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5433af68-73eb-4ac8-86f9-9234b473b175 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 0.533807 Aug 19 15:23:30.729844 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 21/44] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:30 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:31.036745 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18644f66-2420-4cf0-9d48-f752700e908b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:31.037761 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-18644f66-2420-4cf0-9d48-f752700e908b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:31.054082 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18644f66-2420-4cf0-9d48-f752700e908b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:31.055622 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18644f66-2420-4cf0-9d48-f752700e908b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:31.056873 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18644f66-2420-4cf0-9d48-f752700e908b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:31.059263 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18644f66-2420-4cf0-9d48-f752700e908b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:31.059657 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18644f66-2420-4cf0-9d48-f752700e908b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:31.060095 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18644f66-2420-4cf0-9d48-f752700e908b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:31.060204 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c450b24a-b62a-4dd9-9187-2aee0b0a078e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:31.061356 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c450b24a-b62a-4dd9-9187-2aee0b0a078e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:31.077813 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c450b24a-b62a-4dd9-9187-2aee0b0a078e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:31.079394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c450b24a-b62a-4dd9-9187-2aee0b0a078e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:31.080427 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c450b24a-b62a-4dd9-9187-2aee0b0a078e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:31.081486 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c450b24a-b62a-4dd9-9187-2aee0b0a078e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:31.084529 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c450b24a-b62a-4dd9-9187-2aee0b0a078e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:31.085074 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c450b24a-b62a-4dd9-9187-2aee0b0a078e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:31.158414 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-18644f66-2420-4cf0-9d48-f752700e908b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:31.170115 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-18644f66-2420-4cf0-9d48-f752700e908b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1294 microversion: 2.1 time: 0.137304 Aug 19 15:23:31.171276 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 24/45] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:31 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1294 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:31.378538 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c450b24a-b62a-4dd9-9187-2aee0b0a078e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:31.389533 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c450b24a-b62a-4dd9-9187-2aee0b0a078e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1321 microversion: 2.1 time: 0.335286 Aug 19 15:23:31.390487 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 22/46] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:31 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:23:31.701964 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7164808-cdfb-4bed-ab3b-8fc3d11f6354 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:31.703104 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7164808-cdfb-4bed-ab3b-8fc3d11f6354 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:31.731383 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7164808-cdfb-4bed-ab3b-8fc3d11f6354 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:31.732242 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7164808-cdfb-4bed-ab3b-8fc3d11f6354 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:31.732958 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7164808-cdfb-4bed-ab3b-8fc3d11f6354 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:31.734146 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7164808-cdfb-4bed-ab3b-8fc3d11f6354 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:31.734946 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7164808-cdfb-4bed-ab3b-8fc3d11f6354 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:31.735709 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7164808-cdfb-4bed-ab3b-8fc3d11f6354 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:31.768369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-03984814-7787-44ef-a0fe-7ab889bfa5f9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:31.769055 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-03984814-7787-44ef-a0fe-7ab889bfa5f9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:31.779055 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03984814-7787-44ef-a0fe-7ab889bfa5f9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:31.779806 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03984814-7787-44ef-a0fe-7ab889bfa5f9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:31.780477 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03984814-7787-44ef-a0fe-7ab889bfa5f9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:31.794096 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03984814-7787-44ef-a0fe-7ab889bfa5f9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:31.795285 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03984814-7787-44ef-a0fe-7ab889bfa5f9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:31.798724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03984814-7787-44ef-a0fe-7ab889bfa5f9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:31.893784 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7164808-cdfb-4bed-ab3b-8fc3d11f6354 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:31.908659 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7164808-cdfb-4bed-ab3b-8fc3d11f6354 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1295 microversion: 2.1 time: 0.213802 Aug 19 15:23:31.913617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 25/47] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:31 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1295 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:32.191116 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5100b446-9991-4f4c-a13c-a6196fe90f83 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:32.191730 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5100b446-9991-4f4c-a13c-a6196fe90f83 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:32.198162 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5100b446-9991-4f4c-a13c-a6196fe90f83 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:32.198910 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5100b446-9991-4f4c-a13c-a6196fe90f83 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:32.199660 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5100b446-9991-4f4c-a13c-a6196fe90f83 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:32.200559 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5100b446-9991-4f4c-a13c-a6196fe90f83 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:32.201151 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5100b446-9991-4f4c-a13c-a6196fe90f83 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:32.201818 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5100b446-9991-4f4c-a13c-a6196fe90f83 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:32.509913 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5100b446-9991-4f4c-a13c-a6196fe90f83 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:32.523900 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5100b446-9991-4f4c-a13c-a6196fe90f83 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1294 microversion: 2.1 time: 0.336277 Aug 19 15:23:32.536966 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 26/48] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:32 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1294 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:32.551623 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f744d6d2-9e94-408d-b4c1-52b9c27808be tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:32.554471 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f744d6d2-9e94-408d-b4c1-52b9c27808be tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:32.562926 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f744d6d2-9e94-408d-b4c1-52b9c27808be tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:32.563865 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f744d6d2-9e94-408d-b4c1-52b9c27808be tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:32.564826 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f744d6d2-9e94-408d-b4c1-52b9c27808be tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:32.565832 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f744d6d2-9e94-408d-b4c1-52b9c27808be tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:32.566484 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f744d6d2-9e94-408d-b4c1-52b9c27808be tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:32.567225 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f744d6d2-9e94-408d-b4c1-52b9c27808be tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:32.620738 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-03984814-7787-44ef-a0fe-7ab889bfa5f9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:32.631177 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-03984814-7787-44ef-a0fe-7ab889bfa5f9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 0.868081 Aug 19 15:23:32.644535 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 23/49] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:31 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:32.948345 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-71509022-4c52-48d9-b47e-c3731551f16c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:32.948345 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-71509022-4c52-48d9-b47e-c3731551f16c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:32.959577 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71509022-4c52-48d9-b47e-c3731551f16c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:32.959577 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71509022-4c52-48d9-b47e-c3731551f16c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:32.960440 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71509022-4c52-48d9-b47e-c3731551f16c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:32.961079 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71509022-4c52-48d9-b47e-c3731551f16c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:32.961733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71509022-4c52-48d9-b47e-c3731551f16c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:32.962323 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71509022-4c52-48d9-b47e-c3731551f16c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:33.309657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-71509022-4c52-48d9-b47e-c3731551f16c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:33.326290 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-71509022-4c52-48d9-b47e-c3731551f16c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1295 microversion: 2.1 time: 0.386321 Aug 19 15:23:33.335511 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 24/50] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:32 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1295 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:33.551660 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1c17e6ab-619a-4eb9-b513-d7e7e0c78696 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:33.553561 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1c17e6ab-619a-4eb9-b513-d7e7e0c78696 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:33.575247 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c17e6ab-619a-4eb9-b513-d7e7e0c78696 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:33.576129 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c17e6ab-619a-4eb9-b513-d7e7e0c78696 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:33.576603 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c17e6ab-619a-4eb9-b513-d7e7e0c78696 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:33.577499 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c17e6ab-619a-4eb9-b513-d7e7e0c78696 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:33.578269 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c17e6ab-619a-4eb9-b513-d7e7e0c78696 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:33.579170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c17e6ab-619a-4eb9-b513-d7e7e0c78696 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:33.955139 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f744d6d2-9e94-408d-b4c1-52b9c27808be tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:33.983351 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f744d6d2-9e94-408d-b4c1-52b9c27808be tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1321 microversion: 2.1 time: 1.444533 Aug 19 15:23:33.984230 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 27/51] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:32 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1321 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:33.990044 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1c17e6ab-619a-4eb9-b513-d7e7e0c78696 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:34.004908 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1c17e6ab-619a-4eb9-b513-d7e7e0c78696 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1300 microversion: 2.1 time: 0.457278 Aug 19 15:23:34.026112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d705cde6-8fe3-463e-8d47-5667a2fb7678 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:34.027098 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d705cde6-8fe3-463e-8d47-5667a2fb7678 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:34.027862 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 25/52] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:33 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1300 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:34.053434 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d705cde6-8fe3-463e-8d47-5667a2fb7678 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:34.054176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d705cde6-8fe3-463e-8d47-5667a2fb7678 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:34.054756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d705cde6-8fe3-463e-8d47-5667a2fb7678 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:34.055626 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d705cde6-8fe3-463e-8d47-5667a2fb7678 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:34.056239 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d705cde6-8fe3-463e-8d47-5667a2fb7678 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:34.056864 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d705cde6-8fe3-463e-8d47-5667a2fb7678 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:34.364835 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-26bd46fe-f3b9-45f3-84ee-3b47f970c5c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:34.364835 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-26bd46fe-f3b9-45f3-84ee-3b47f970c5c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:34.387042 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26bd46fe-f3b9-45f3-84ee-3b47f970c5c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:34.393027 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26bd46fe-f3b9-45f3-84ee-3b47f970c5c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:34.396184 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26bd46fe-f3b9-45f3-84ee-3b47f970c5c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:34.397617 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26bd46fe-f3b9-45f3-84ee-3b47f970c5c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:34.400458 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26bd46fe-f3b9-45f3-84ee-3b47f970c5c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:34.405066 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26bd46fe-f3b9-45f3-84ee-3b47f970c5c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:34.464979 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:34.480159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d705cde6-8fe3-463e-8d47-5667a2fb7678 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:34.498603 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d705cde6-8fe3-463e-8d47-5667a2fb7678 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 0.510061 Aug 19 15:23:34.500031 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 28/53] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:33 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:34.751379 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-26bd46fe-f3b9-45f3-84ee-3b47f970c5c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:34.779733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-26bd46fe-f3b9-45f3-84ee-3b47f970c5c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1295 microversion: 2.1 time: 0.427219 Aug 19 15:23:34.782597 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 26/54] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:34 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1295 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:35.004267 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a435268e-8124-432d-9f05-7638a47b669c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:35.005510 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a435268e-8124-432d-9f05-7638a47b669c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:35.017111 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a435268e-8124-432d-9f05-7638a47b669c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:35.024720 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a435268e-8124-432d-9f05-7638a47b669c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:35.027575 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a435268e-8124-432d-9f05-7638a47b669c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:35.030722 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a435268e-8124-432d-9f05-7638a47b669c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:35.032461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a435268e-8124-432d-9f05-7638a47b669c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:35.034721 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a435268e-8124-432d-9f05-7638a47b669c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:35.038477 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c2cef0c7-5bee-4473-b4cc-0ea4da411742 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:35.039497 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c2cef0c7-5bee-4473-b4cc-0ea4da411742 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:35.066936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2cef0c7-5bee-4473-b4cc-0ea4da411742 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:35.069996 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2cef0c7-5bee-4473-b4cc-0ea4da411742 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:35.070533 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2cef0c7-5bee-4473-b4cc-0ea4da411742 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:35.073268 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2cef0c7-5bee-4473-b4cc-0ea4da411742 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:35.076629 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2cef0c7-5bee-4473-b4cc-0ea4da411742 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:35.077089 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2cef0c7-5bee-4473-b4cc-0ea4da411742 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:35.398759 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c2cef0c7-5bee-4473-b4cc-0ea4da411742 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:35.399705 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=22 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:35.409319 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c2cef0c7-5bee-4473-b4cc-0ea4da411742 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1300 microversion: 2.1 time: 0.378007 Aug 19 15:23:35.410439 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 27/55] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:35 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1300 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:35.531257 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ea1a05bd-35fd-49dc-a18c-9f8527412f97 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:35.532584 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ea1a05bd-35fd-49dc-a18c-9f8527412f97 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:35.550507 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea1a05bd-35fd-49dc-a18c-9f8527412f97 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:35.551368 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea1a05bd-35fd-49dc-a18c-9f8527412f97 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:35.553497 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea1a05bd-35fd-49dc-a18c-9f8527412f97 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:35.554576 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea1a05bd-35fd-49dc-a18c-9f8527412f97 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:35.555182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea1a05bd-35fd-49dc-a18c-9f8527412f97 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:35.555870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea1a05bd-35fd-49dc-a18c-9f8527412f97 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:36.411738 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a435268e-8124-432d-9f05-7638a47b669c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:36.440521 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a435268e-8124-432d-9f05-7638a47b669c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1321 microversion: 2.1 time: 1.436268 Aug 19 15:23:36.453467 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 29/56] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:34 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1321 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:36.470388 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-47b0d94d-f6cc-449d-be30-2731792fdd3a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:36.471066 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-47b0d94d-f6cc-449d-be30-2731792fdd3a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:36.492533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47b0d94d-f6cc-449d-be30-2731792fdd3a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:36.493114 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47b0d94d-f6cc-449d-be30-2731792fdd3a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:36.493639 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47b0d94d-f6cc-449d-be30-2731792fdd3a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:36.494437 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47b0d94d-f6cc-449d-be30-2731792fdd3a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:36.495662 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47b0d94d-f6cc-449d-be30-2731792fdd3a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:36.496088 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47b0d94d-f6cc-449d-be30-2731792fdd3a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:36.798648 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ea1a05bd-35fd-49dc-a18c-9f8527412f97 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:36.836277 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ea1a05bd-35fd-49dc-a18c-9f8527412f97 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 1.312562 Aug 19 15:23:36.845406 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 28/57] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:35 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:23:36.863857 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4f45bd7a-f6ae-40c1-ba99-8e99857fe9f0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:36.875184 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4f45bd7a-f6ae-40c1-ba99-8e99857fe9f0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:36.878580 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:36.895281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f45bd7a-f6ae-40c1-ba99-8e99857fe9f0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:36.903546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f45bd7a-f6ae-40c1-ba99-8e99857fe9f0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:36.904553 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f45bd7a-f6ae-40c1-ba99-8e99857fe9f0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:36.908989 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f45bd7a-f6ae-40c1-ba99-8e99857fe9f0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:36.917446 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f45bd7a-f6ae-40c1-ba99-8e99857fe9f0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:36.918367 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f45bd7a-f6ae-40c1-ba99-8e99857fe9f0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:36.972990 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=6 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:37.452850 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-47b0d94d-f6cc-449d-be30-2731792fdd3a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:37.465382 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-47b0d94d-f6cc-449d-be30-2731792fdd3a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1363 microversion: 2.1 time: 1.023010 Aug 19 15:23:37.470318 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 30/58] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:36 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1363 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:37.643400 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4f45bd7a-f6ae-40c1-ba99-8e99857fe9f0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:37.659294 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4f45bd7a-f6ae-40c1-ba99-8e99857fe9f0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1367 microversion: 2.1 time: 0.811687 Aug 19 15:23:37.660540 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 29/59] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:36 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1367 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:37.687718 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c5314687-0aad-4407-8767-c43ec6ba009e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:37.691389 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c5314687-0aad-4407-8767-c43ec6ba009e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:37.705093 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5314687-0aad-4407-8767-c43ec6ba009e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:37.707142 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5314687-0aad-4407-8767-c43ec6ba009e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:37.708956 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5314687-0aad-4407-8767-c43ec6ba009e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:37.713399 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5314687-0aad-4407-8767-c43ec6ba009e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:37.715841 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5314687-0aad-4407-8767-c43ec6ba009e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:37.716694 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5314687-0aad-4407-8767-c43ec6ba009e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:37.893231 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-510d0d7f-c215-4a8c-aec4-a2bb935c1b81 req-b2dd2645-e837-4250-a1f7-ed4ba4da10ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10c60ba0-a623-41bb-ba6c-e9ff6e6a4802", "tag": "b97f032a-18f2-4b4c-aa4a-57e19ac342cd"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:23:37.914029 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-510d0d7f-c215-4a8c-aec4-a2bb935c1b81 req-b2dd2645-e837-4250-a1f7-ed4ba4da10ee service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:37.915015 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-510d0d7f-c215-4a8c-aec4-a2bb935c1b81 req-b2dd2645-e837-4250-a1f7-ed4ba4da10ee service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:37.916444 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-510d0d7f-c215-4a8c-aec4-a2bb935c1b81 req-b2dd2645-e837-4250-a1f7-ed4ba4da10ee service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:37.945460 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-510d0d7f-c215-4a8c-aec4-a2bb935c1b81 req-b2dd2645-e837-4250-a1f7-ed4ba4da10ee service nova] Creating event network-changed:b97f032a-18f2-4b4c-aa4a-57e19ac342cd for instance 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 on hv-cinder-83538 Aug 19 15:23:37.946974 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-510d0d7f-c215-4a8c-aec4-a2bb935c1b81 req-b2dd2645-e837-4250-a1f7-ed4ba4da10ee service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 19 15:23:37.947593 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-510d0d7f-c215-4a8c-aec4-a2bb935c1b81 req-b2dd2645-e837-4250-a1f7-ed4ba4da10ee service nova] Acquired lock "compute-rpcapi-router" {{(pid=120637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 19 15:23:37.949129 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3910a4b3-bb76-4b12-bdab-adb677ae327d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:37.949815 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3910a4b3-bb76-4b12-bdab-adb677ae327d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:37.950660 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3910a4b3-bb76-4b12-bdab-adb677ae327d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:37.953040 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3910a4b3-bb76-4b12-bdab-adb677ae327d None None] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:37.955314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3910a4b3-bb76-4b12-bdab-adb677ae327d None None] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:37.956327 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3910a4b3-bb76-4b12-bdab-adb677ae327d None None] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:37.970130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.compute.rpcapi [None req-3910a4b3-bb76-4b12-bdab-adb677ae327d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 19 15:23:37.973196 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3910a4b3-bb76-4b12-bdab-adb677ae327d None None] Releasing lock "compute-rpcapi-router" {{(pid=120637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 19 15:23:37.998168 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3910a4b3-bb76-4b12-bdab-adb677ae327d None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.525635 Aug 19 15:23:37.999405 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 31/60] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:23:38.006980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f990dee4-a89b-463c-842a-832b50eaf03b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:38.008612 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f990dee4-a89b-463c-842a-832b50eaf03b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:38.016458 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f990dee4-a89b-463c-842a-832b50eaf03b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:38.017547 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f990dee4-a89b-463c-842a-832b50eaf03b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:38.018756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f990dee4-a89b-463c-842a-832b50eaf03b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:38.019714 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f990dee4-a89b-463c-842a-832b50eaf03b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:38.023932 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f990dee4-a89b-463c-842a-832b50eaf03b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:38.024838 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f990dee4-a89b-463c-842a-832b50eaf03b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:38.123543 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=28 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:38.891263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c5314687-0aad-4407-8767-c43ec6ba009e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:38.903526 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c5314687-0aad-4407-8767-c43ec6ba009e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1321 microversion: 2.1 time: 1.241496 Aug 19 15:23:38.909930 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 30/61] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:37 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1321 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:38.927787 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-86ea902e-a9d6-4366-86b9-924e2df0bdd1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:38.930690 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-86ea902e-a9d6-4366-86b9-924e2df0bdd1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:38.960235 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86ea902e-a9d6-4366-86b9-924e2df0bdd1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:38.962985 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86ea902e-a9d6-4366-86b9-924e2df0bdd1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:38.966111 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86ea902e-a9d6-4366-86b9-924e2df0bdd1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:38.968765 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86ea902e-a9d6-4366-86b9-924e2df0bdd1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:38.969990 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86ea902e-a9d6-4366-86b9-924e2df0bdd1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:38.972777 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86ea902e-a9d6-4366-86b9-924e2df0bdd1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:39.019693 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f990dee4-a89b-463c-842a-832b50eaf03b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:39.033358 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f990dee4-a89b-463c-842a-832b50eaf03b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 1.032123 Aug 19 15:23:39.033947 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 32/62] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:37 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:39.039982 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-12471a39-b240-42d6-9b18-a21b87ffc5ba tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:39.049122 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-12471a39-b240-42d6-9b18-a21b87ffc5ba tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:39.051264 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:39.062284 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12471a39-b240-42d6-9b18-a21b87ffc5ba tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:39.062775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12471a39-b240-42d6-9b18-a21b87ffc5ba tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:39.063349 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12471a39-b240-42d6-9b18-a21b87ffc5ba tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:39.064053 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12471a39-b240-42d6-9b18-a21b87ffc5ba tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:39.073279 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12471a39-b240-42d6-9b18-a21b87ffc5ba tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:39.073953 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12471a39-b240-42d6-9b18-a21b87ffc5ba tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:39.079425 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:39.593346 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-12471a39-b240-42d6-9b18-a21b87ffc5ba tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:39.610923 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-86ea902e-a9d6-4366-86b9-924e2df0bdd1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:39.613700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-12471a39-b240-42d6-9b18-a21b87ffc5ba tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1367 microversion: 2.1 time: 0.578241 Aug 19 15:23:39.629737 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 33/63] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:39 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1367 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:39.632133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-86ea902e-a9d6-4366-86b9-924e2df0bdd1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1363 microversion: 2.1 time: 0.719275 Aug 19 15:23:39.632133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 31/64] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:38 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1363 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:39.935232 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5b1a982-8642-41e5-9040-8c75058bbc6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:39.936090 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5b1a982-8642-41e5-9040-8c75058bbc6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:39.947211 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5b1a982-8642-41e5-9040-8c75058bbc6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:39.948056 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5b1a982-8642-41e5-9040-8c75058bbc6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:39.948685 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5b1a982-8642-41e5-9040-8c75058bbc6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:39.949755 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5b1a982-8642-41e5-9040-8c75058bbc6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:39.950218 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5b1a982-8642-41e5-9040-8c75058bbc6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:39.950644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5b1a982-8642-41e5-9040-8c75058bbc6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:40.059190 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1a5dbb9f-cb5e-41b3-8ca4-4365ab7c0564 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:40.060191 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1a5dbb9f-cb5e-41b3-8ca4-4365ab7c0564 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:40.070791 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a5dbb9f-cb5e-41b3-8ca4-4365ab7c0564 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:40.073086 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a5dbb9f-cb5e-41b3-8ca4-4365ab7c0564 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:40.073944 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a5dbb9f-cb5e-41b3-8ca4-4365ab7c0564 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:40.074909 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a5dbb9f-cb5e-41b3-8ca4-4365ab7c0564 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:40.078312 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a5dbb9f-cb5e-41b3-8ca4-4365ab7c0564 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:40.078957 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a5dbb9f-cb5e-41b3-8ca4-4365ab7c0564 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:40.131675 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:41.075461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5b1a982-8642-41e5-9040-8c75058bbc6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:41.086282 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5b1a982-8642-41e5-9040-8c75058bbc6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1321 microversion: 2.1 time: 1.155493 Aug 19 15:23:41.094874 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 34/65] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:39 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1321 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:41.111128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-f9811856-3964-4531-adc5-9385b54b9966 req-860b461a-e16e-4600-a363-fcc6f900bf79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ac8d32c-fd72-4373-8957-3e1698b2dd3c", "tag": "e851153e-06d0-452a-ac68-7efce3d3bf25"}, {"name": "network-changed", "server_uuid": "903776c1-6779-4794-81e4-257cbfdb5908", "tag": "44c3f537-79e8-434b-8284-5ff8ab0dcb5c"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:23:41.159053 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f9811856-3964-4531-adc5-9385b54b9966 req-860b461a-e16e-4600-a363-fcc6f900bf79 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:41.159904 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f9811856-3964-4531-adc5-9385b54b9966 req-860b461a-e16e-4600-a363-fcc6f900bf79 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:41.163800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f9811856-3964-4531-adc5-9385b54b9966 req-860b461a-e16e-4600-a363-fcc6f900bf79 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:41.189992 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1a5dbb9f-cb5e-41b3-8ca4-4365ab7c0564 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:41.192564 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-f9811856-3964-4531-adc5-9385b54b9966 req-860b461a-e16e-4600-a363-fcc6f900bf79 service nova] Creating event network-changed:e851153e-06d0-452a-ac68-7efce3d3bf25 for instance 9ac8d32c-fd72-4373-8957-3e1698b2dd3c on hv-cinder-83538 Aug 19 15:23:41.194922 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-f9811856-3964-4531-adc5-9385b54b9966 req-860b461a-e16e-4600-a363-fcc6f900bf79 service nova] Creating event network-changed:44c3f537-79e8-434b-8284-5ff8ab0dcb5c for instance 903776c1-6779-4794-81e4-257cbfdb5908 on hv-cinder-83538 Aug 19 15:23:41.203115 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1a5dbb9f-cb5e-41b3-8ca4-4365ab7c0564 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 1.145812 Aug 19 15:23:41.217886 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 32/66] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:40 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:41.226296 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-f9811856-3964-4531-adc5-9385b54b9966 req-860b461a-e16e-4600-a363-fcc6f900bf79 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.128565 Aug 19 15:23:41.227257 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 35/67] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:23:41.235302 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d8906e2c-486e-4c29-897f-32154ba4df67 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:41.236596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d8906e2c-486e-4c29-897f-32154ba4df67 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:41.236734 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0b1ffbee-2c78-48a2-b6d4-22d100063102 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:41.237746 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0b1ffbee-2c78-48a2-b6d4-22d100063102 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:41.251293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8906e2c-486e-4c29-897f-32154ba4df67 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:41.252271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8906e2c-486e-4c29-897f-32154ba4df67 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:41.252951 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8906e2c-486e-4c29-897f-32154ba4df67 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:41.253995 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8906e2c-486e-4c29-897f-32154ba4df67 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:41.255059 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8906e2c-486e-4c29-897f-32154ba4df67 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:41.255852 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8906e2c-486e-4c29-897f-32154ba4df67 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:41.281353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b1ffbee-2c78-48a2-b6d4-22d100063102 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:41.283280 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b1ffbee-2c78-48a2-b6d4-22d100063102 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:41.284036 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b1ffbee-2c78-48a2-b6d4-22d100063102 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:41.285102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b1ffbee-2c78-48a2-b6d4-22d100063102 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:41.285577 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b1ffbee-2c78-48a2-b6d4-22d100063102 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:41.286026 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b1ffbee-2c78-48a2-b6d4-22d100063102 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:41.986973 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d8906e2c-486e-4c29-897f-32154ba4df67 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:42.014002 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d8906e2c-486e-4c29-897f-32154ba4df67 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1363 microversion: 2.1 time: 0.785064 Aug 19 15:23:42.014863 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 36/68] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:41 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1363 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:42.196138 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0b1ffbee-2c78-48a2-b6d4-22d100063102 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:42.208821 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0b1ffbee-2c78-48a2-b6d4-22d100063102 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1367 microversion: 2.1 time: 1.000352 Aug 19 15:23:42.212988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 33/69] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:41 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1367 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:42.231540 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5fe9aeba-32d4-4bbd-a5ad-4f4e9d6ca51f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:42.235038 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5fe9aeba-32d4-4bbd-a5ad-4f4e9d6ca51f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:42.261018 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fe9aeba-32d4-4bbd-a5ad-4f4e9d6ca51f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:42.262521 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fe9aeba-32d4-4bbd-a5ad-4f4e9d6ca51f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:42.265262 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fe9aeba-32d4-4bbd-a5ad-4f4e9d6ca51f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:42.267568 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fe9aeba-32d4-4bbd-a5ad-4f4e9d6ca51f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:42.268989 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fe9aeba-32d4-4bbd-a5ad-4f4e9d6ca51f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:42.271489 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fe9aeba-32d4-4bbd-a5ad-4f4e9d6ca51f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:42.637780 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-72c0ab79-2781-40dd-b546-22670c371b7f req-98ca0a4c-95a4-49ad-8306-ac66121d5dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d", "tag": "489cb252-e00c-4932-b659-de93c87cfb6a"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:23:42.662796 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-72c0ab79-2781-40dd-b546-22670c371b7f req-98ca0a4c-95a4-49ad-8306-ac66121d5dd5 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:42.663540 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-72c0ab79-2781-40dd-b546-22670c371b7f req-98ca0a4c-95a4-49ad-8306-ac66121d5dd5 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:42.664898 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-72c0ab79-2781-40dd-b546-22670c371b7f req-98ca0a4c-95a4-49ad-8306-ac66121d5dd5 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:42.704035 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-72c0ab79-2781-40dd-b546-22670c371b7f req-98ca0a4c-95a4-49ad-8306-ac66121d5dd5 service nova] Creating event network-changed:489cb252-e00c-4932-b659-de93c87cfb6a for instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d on hv-cinder-83538 Aug 19 15:23:42.717017 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-72c0ab79-2781-40dd-b546-22670c371b7f req-98ca0a4c-95a4-49ad-8306-ac66121d5dd5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.697503 Aug 19 15:23:42.719798 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 37/70] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:23:42.740958 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c59ab590-e621-4de2-ad0e-63928da53449 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:42.745911 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c59ab590-e621-4de2-ad0e-63928da53449 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:42.764361 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c59ab590-e621-4de2-ad0e-63928da53449 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:42.765090 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c59ab590-e621-4de2-ad0e-63928da53449 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:42.765625 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c59ab590-e621-4de2-ad0e-63928da53449 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:42.766443 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c59ab590-e621-4de2-ad0e-63928da53449 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:42.768967 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c59ab590-e621-4de2-ad0e-63928da53449 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:42.769676 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c59ab590-e621-4de2-ad0e-63928da53449 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:43.178600 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5fe9aeba-32d4-4bbd-a5ad-4f4e9d6ca51f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:43.195451 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5fe9aeba-32d4-4bbd-a5ad-4f4e9d6ca51f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1321 microversion: 2.1 time: 0.979639 Aug 19 15:23:43.196152 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 34/71] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:42 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1321 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:43.217007 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6a081fce-5b62-4c83-b1e5-37cb0c40c97d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:43.219690 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6a081fce-5b62-4c83-b1e5-37cb0c40c97d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:43.231731 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a081fce-5b62-4c83-b1e5-37cb0c40c97d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:43.233046 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a081fce-5b62-4c83-b1e5-37cb0c40c97d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:43.234090 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a081fce-5b62-4c83-b1e5-37cb0c40c97d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:43.235700 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a081fce-5b62-4c83-b1e5-37cb0c40c97d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:43.236819 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a081fce-5b62-4c83-b1e5-37cb0c40c97d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:43.237740 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a081fce-5b62-4c83-b1e5-37cb0c40c97d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:43.294590 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c59ab590-e621-4de2-ad0e-63928da53449 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:43.306032 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c59ab590-e621-4de2-ad0e-63928da53449 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 0.582339 Aug 19 15:23:43.306628 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 38/72] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:42 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:43.324540 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-901254ab-b06b-4088-ab55-a63a1c5df318 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:43.329788 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-901254ab-b06b-4088-ab55-a63a1c5df318 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:43.341162 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-901254ab-b06b-4088-ab55-a63a1c5df318 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:43.341162 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-901254ab-b06b-4088-ab55-a63a1c5df318 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:43.341360 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-901254ab-b06b-4088-ab55-a63a1c5df318 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:43.344878 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-901254ab-b06b-4088-ab55-a63a1c5df318 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:43.346290 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-901254ab-b06b-4088-ab55-a63a1c5df318 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:43.347562 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-901254ab-b06b-4088-ab55-a63a1c5df318 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:43.564431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6a081fce-5b62-4c83-b1e5-37cb0c40c97d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:43.576819 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6a081fce-5b62-4c83-b1e5-37cb0c40c97d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1363 microversion: 2.1 time: 0.378120 Aug 19 15:23:43.578642 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 35/73] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:43 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1363 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:43.681325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-901254ab-b06b-4088-ab55-a63a1c5df318 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:43.696508 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-901254ab-b06b-4088-ab55-a63a1c5df318 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1367 microversion: 2.1 time: 0.381809 Aug 19 15:23:43.697106 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 39/74] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:43 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1367 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:44.223280 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4fa35546-a0a8-4990-be2f-4ef98b36625c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:44.225074 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4fa35546-a0a8-4990-be2f-4ef98b36625c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:44.234193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fa35546-a0a8-4990-be2f-4ef98b36625c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:44.234680 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fa35546-a0a8-4990-be2f-4ef98b36625c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:44.235489 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fa35546-a0a8-4990-be2f-4ef98b36625c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:44.236502 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fa35546-a0a8-4990-be2f-4ef98b36625c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:44.237353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fa35546-a0a8-4990-be2f-4ef98b36625c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:44.238380 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fa35546-a0a8-4990-be2f-4ef98b36625c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:44.328878 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c0d5d00f-98fd-4d7b-a6f0-0dbeaf907099 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:44.329739 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c0d5d00f-98fd-4d7b-a6f0-0dbeaf907099 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:44.336413 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0d5d00f-98fd-4d7b-a6f0-0dbeaf907099 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:44.343220 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0d5d00f-98fd-4d7b-a6f0-0dbeaf907099 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:44.344015 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0d5d00f-98fd-4d7b-a6f0-0dbeaf907099 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:44.345790 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0d5d00f-98fd-4d7b-a6f0-0dbeaf907099 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:44.346538 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0d5d00f-98fd-4d7b-a6f0-0dbeaf907099 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:44.347319 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0d5d00f-98fd-4d7b-a6f0-0dbeaf907099 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:44.475216 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4fa35546-a0a8-4990-be2f-4ef98b36625c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:44.490507 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4fa35546-a0a8-4990-be2f-4ef98b36625c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1321 microversion: 2.1 time: 0.277993 Aug 19 15:23:44.491325 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 36/75] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:44 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:44.600633 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c0d5d00f-98fd-4d7b-a6f0-0dbeaf907099 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:44.608433 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e91debac-8d6f-4edd-853c-9ade0b65c079 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:44.609661 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e91debac-8d6f-4edd-853c-9ade0b65c079 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:44.619188 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c0d5d00f-98fd-4d7b-a6f0-0dbeaf907099 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 0.295653 Aug 19 15:23:44.620339 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e91debac-8d6f-4edd-853c-9ade0b65c079 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:44.625310 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e91debac-8d6f-4edd-853c-9ade0b65c079 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:44.627830 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e91debac-8d6f-4edd-853c-9ade0b65c079 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:44.631730 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e91debac-8d6f-4edd-853c-9ade0b65c079 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:44.633014 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e91debac-8d6f-4edd-853c-9ade0b65c079 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:44.634155 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 40/76] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:44 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:44.636267 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e91debac-8d6f-4edd-853c-9ade0b65c079 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:44.722230 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-84f035d5-9839-41ec-a30e-2dff7a250a51 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:44.723713 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-84f035d5-9839-41ec-a30e-2dff7a250a51 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:44.731735 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84f035d5-9839-41ec-a30e-2dff7a250a51 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:44.732629 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84f035d5-9839-41ec-a30e-2dff7a250a51 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:44.733315 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84f035d5-9839-41ec-a30e-2dff7a250a51 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:44.734079 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84f035d5-9839-41ec-a30e-2dff7a250a51 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:44.734708 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84f035d5-9839-41ec-a30e-2dff7a250a51 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:44.735305 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84f035d5-9839-41ec-a30e-2dff7a250a51 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:44.891864 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e91debac-8d6f-4edd-853c-9ade0b65c079 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:44.909115 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e91debac-8d6f-4edd-853c-9ade0b65c079 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1363 microversion: 2.1 time: 0.305288 Aug 19 15:23:44.920571 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 37/77] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:44 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:23:44.972175 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-84f035d5-9839-41ec-a30e-2dff7a250a51 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:44.988217 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-84f035d5-9839-41ec-a30e-2dff7a250a51 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1367 microversion: 2.1 time: 0.270888 Aug 19 15:23:44.989798 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 41/78] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:44 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:45.103785 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-67318958-4460-454d-97eb-82a3f6221085 req-eb9fc5c8-41b6-42b9-9012-2b8851d73a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13d4563-5477-4605-9b1b-85113d779753", "tag": "02304f9d-f8e5-4fc7-8c86-f4b23da124da"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:23:45.120322 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-67318958-4460-454d-97eb-82a3f6221085 req-eb9fc5c8-41b6-42b9-9012-2b8851d73a00 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:45.121222 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-67318958-4460-454d-97eb-82a3f6221085 req-eb9fc5c8-41b6-42b9-9012-2b8851d73a00 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:45.122134 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-67318958-4460-454d-97eb-82a3f6221085 req-eb9fc5c8-41b6-42b9-9012-2b8851d73a00 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:45.145527 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-67318958-4460-454d-97eb-82a3f6221085 req-eb9fc5c8-41b6-42b9-9012-2b8851d73a00 service nova] Creating event network-changed:02304f9d-f8e5-4fc7-8c86-f4b23da124da for instance c13d4563-5477-4605-9b1b-85113d779753 on hv-cinder-83538 Aug 19 15:23:45.146051 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-67318958-4460-454d-97eb-82a3f6221085 req-eb9fc5c8-41b6-42b9-9012-2b8851d73a00 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 19 15:23:45.146438 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-67318958-4460-454d-97eb-82a3f6221085 req-eb9fc5c8-41b6-42b9-9012-2b8851d73a00 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 19 15:23:45.147761 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebd03b07-9d5b-47bf-bf44-0cac8185a856 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:45.148383 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebd03b07-9d5b-47bf-bf44-0cac8185a856 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:45.148971 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebd03b07-9d5b-47bf-bf44-0cac8185a856 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:45.150010 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebd03b07-9d5b-47bf-bf44-0cac8185a856 None None] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:45.151303 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebd03b07-9d5b-47bf-bf44-0cac8185a856 None None] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:45.151909 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebd03b07-9d5b-47bf-bf44-0cac8185a856 None None] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:45.161961 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.compute.rpcapi [None req-ebd03b07-9d5b-47bf-bf44-0cac8185a856 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 19 15:23:45.162854 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebd03b07-9d5b-47bf-bf44-0cac8185a856 None None] Releasing lock "compute-rpcapi-router" {{(pid=120638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 19 15:23:45.198933 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ebd03b07-9d5b-47bf-bf44-0cac8185a856 None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099587 Aug 19 15:23:45.199567 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 38/79] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:23:45.517482 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ce4f2c54-2fd8-4d65-9c9e-7044ebbcff22 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:45.518631 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ce4f2c54-2fd8-4d65-9c9e-7044ebbcff22 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:45.532700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce4f2c54-2fd8-4d65-9c9e-7044ebbcff22 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:45.534116 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce4f2c54-2fd8-4d65-9c9e-7044ebbcff22 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:45.535206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce4f2c54-2fd8-4d65-9c9e-7044ebbcff22 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:45.536328 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce4f2c54-2fd8-4d65-9c9e-7044ebbcff22 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:45.537119 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce4f2c54-2fd8-4d65-9c9e-7044ebbcff22 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:45.537675 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce4f2c54-2fd8-4d65-9c9e-7044ebbcff22 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:45.651019 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c8db073c-9c9d-472a-b3d2-df1038fb109b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:45.652131 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c8db073c-9c9d-472a-b3d2-df1038fb109b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:45.669238 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8db073c-9c9d-472a-b3d2-df1038fb109b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:45.669769 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8db073c-9c9d-472a-b3d2-df1038fb109b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:45.674770 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8db073c-9c9d-472a-b3d2-df1038fb109b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:45.675567 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8db073c-9c9d-472a-b3d2-df1038fb109b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:45.676062 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8db073c-9c9d-472a-b3d2-df1038fb109b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:45.676537 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8db073c-9c9d-472a-b3d2-df1038fb109b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:46.183675 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ce4f2c54-2fd8-4d65-9c9e-7044ebbcff22 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:46.194902 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ce4f2c54-2fd8-4d65-9c9e-7044ebbcff22 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1321 microversion: 2.1 time: 0.684933 Aug 19 15:23:46.196405 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c8db073c-9c9d-472a-b3d2-df1038fb109b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:46.196966 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 42/80] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:45 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1321 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:46.204989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-32ede639-a708-4db6-a523-9d6881613744 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:46.205960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-32ede639-a708-4db6-a523-9d6881613744 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:46.211931 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c8db073c-9c9d-472a-b3d2-df1038fb109b tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 0.568111 Aug 19 15:23:46.215050 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32ede639-a708-4db6-a523-9d6881613744 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:46.216164 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32ede639-a708-4db6-a523-9d6881613744 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:46.216985 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32ede639-a708-4db6-a523-9d6881613744 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:46.218484 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32ede639-a708-4db6-a523-9d6881613744 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:46.219163 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32ede639-a708-4db6-a523-9d6881613744 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:46.220347 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32ede639-a708-4db6-a523-9d6881613744 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:46.225238 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 39/81] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:45 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:23:46.233826 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-94722bb7-0e6b-485a-94c8-a929fd2d1e91 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:46.234706 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-94722bb7-0e6b-485a-94c8-a929fd2d1e91 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:46.241978 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94722bb7-0e6b-485a-94c8-a929fd2d1e91 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:46.243012 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94722bb7-0e6b-485a-94c8-a929fd2d1e91 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:46.243643 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94722bb7-0e6b-485a-94c8-a929fd2d1e91 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:46.245392 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94722bb7-0e6b-485a-94c8-a929fd2d1e91 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:46.245859 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94722bb7-0e6b-485a-94c8-a929fd2d1e91 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:46.246441 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94722bb7-0e6b-485a-94c8-a929fd2d1e91 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:46.487253 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-94722bb7-0e6b-485a-94c8-a929fd2d1e91 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:46.493948 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-32ede639-a708-4db6-a523-9d6881613744 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:46.496781 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-94722bb7-0e6b-485a-94c8-a929fd2d1e91 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1367 microversion: 2.1 time: 0.269823 Aug 19 15:23:46.497677 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 40/82] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:46 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:46.511060 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-32ede639-a708-4db6-a523-9d6881613744 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1363 microversion: 2.1 time: 0.311468 Aug 19 15:23:46.512293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 43/83] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:46 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:47.223034 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3dcfb40a-cc7d-4959-aa39-285eca5d17af tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:47.224358 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3dcfb40a-cc7d-4959-aa39-285eca5d17af tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:47.232213 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3dcfb40a-cc7d-4959-aa39-285eca5d17af tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:47.233100 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3dcfb40a-cc7d-4959-aa39-285eca5d17af tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:47.241958 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c2272682-8ef8-4012-a09b-3127dc2d9455 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:47.244072 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c2272682-8ef8-4012-a09b-3127dc2d9455 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:47.247747 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3dcfb40a-cc7d-4959-aa39-285eca5d17af tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:47.248882 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3dcfb40a-cc7d-4959-aa39-285eca5d17af tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:47.249566 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3dcfb40a-cc7d-4959-aa39-285eca5d17af tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:47.250500 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3dcfb40a-cc7d-4959-aa39-285eca5d17af tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:47.259390 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2272682-8ef8-4012-a09b-3127dc2d9455 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:47.261636 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2272682-8ef8-4012-a09b-3127dc2d9455 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:47.262885 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2272682-8ef8-4012-a09b-3127dc2d9455 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:47.264370 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2272682-8ef8-4012-a09b-3127dc2d9455 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:47.265093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2272682-8ef8-4012-a09b-3127dc2d9455 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:47.265724 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2272682-8ef8-4012-a09b-3127dc2d9455 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:47.602044 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c2272682-8ef8-4012-a09b-3127dc2d9455 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:47.617515 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c2272682-8ef8-4012-a09b-3127dc2d9455 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 0.382638 Aug 19 15:23:47.627556 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 44/84] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:47 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:23:47.643378 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-27be87da-4aec-49e5-b87c-2a1931edd129 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:47.647463 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-27be87da-4aec-49e5-b87c-2a1931edd129 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:47.662818 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27be87da-4aec-49e5-b87c-2a1931edd129 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:47.673277 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27be87da-4aec-49e5-b87c-2a1931edd129 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:47.673808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27be87da-4aec-49e5-b87c-2a1931edd129 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:47.676006 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27be87da-4aec-49e5-b87c-2a1931edd129 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:47.681712 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27be87da-4aec-49e5-b87c-2a1931edd129 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:47.683567 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27be87da-4aec-49e5-b87c-2a1931edd129 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:47.696833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3dcfb40a-cc7d-4959-aa39-285eca5d17af tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:47.710540 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3dcfb40a-cc7d-4959-aa39-285eca5d17af tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1321 microversion: 2.1 time: 0.495251 Aug 19 15:23:47.722136 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 41/85] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:47 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1321 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:47.739204 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e1ef00a7-db71-4b3b-a8ce-7f47841019e1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:47.739832 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e1ef00a7-db71-4b3b-a8ce-7f47841019e1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:47.757767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1ef00a7-db71-4b3b-a8ce-7f47841019e1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:47.758266 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1ef00a7-db71-4b3b-a8ce-7f47841019e1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:47.758708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1ef00a7-db71-4b3b-a8ce-7f47841019e1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:47.759493 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1ef00a7-db71-4b3b-a8ce-7f47841019e1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:47.759955 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1ef00a7-db71-4b3b-a8ce-7f47841019e1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:47.760462 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1ef00a7-db71-4b3b-a8ce-7f47841019e1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:47.969393 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:48.076957 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-27be87da-4aec-49e5-b87c-2a1931edd129 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:48.095255 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-27be87da-4aec-49e5-b87c-2a1931edd129 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1367 microversion: 2.1 time: 0.456908 Aug 19 15:23:48.096604 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 45/86] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:47 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1367 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:48.164673 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e1ef00a7-db71-4b3b-a8ce-7f47841019e1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:48.164673 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e1ef00a7-db71-4b3b-a8ce-7f47841019e1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1363 microversion: 2.1 time: 0.429254 Aug 19 15:23:48.164673 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 42/87] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:47 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1363 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:48.647511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4f01464f-afce-4cc5-b051-5289c40424e9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:48.648895 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4f01464f-afce-4cc5-b051-5289c40424e9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:48.656139 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f01464f-afce-4cc5-b051-5289c40424e9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:48.656958 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f01464f-afce-4cc5-b051-5289c40424e9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:48.657493 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f01464f-afce-4cc5-b051-5289c40424e9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:48.658291 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f01464f-afce-4cc5-b051-5289c40424e9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:48.658954 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f01464f-afce-4cc5-b051-5289c40424e9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:48.659407 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f01464f-afce-4cc5-b051-5289c40424e9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:48.734391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c67550ae-ef09-4f96-b68f-fbd74024edfa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:48.735122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c67550ae-ef09-4f96-b68f-fbd74024edfa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:48.741319 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c67550ae-ef09-4f96-b68f-fbd74024edfa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:48.742533 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c67550ae-ef09-4f96-b68f-fbd74024edfa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:48.742977 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c67550ae-ef09-4f96-b68f-fbd74024edfa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:48.743687 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c67550ae-ef09-4f96-b68f-fbd74024edfa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:48.744139 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c67550ae-ef09-4f96-b68f-fbd74024edfa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:48.745323 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c67550ae-ef09-4f96-b68f-fbd74024edfa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:48.898688 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4f01464f-afce-4cc5-b051-5289c40424e9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:48.911256 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4f01464f-afce-4cc5-b051-5289c40424e9 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 0.267558 Aug 19 15:23:48.911846 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 46/88] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:48 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:48.939038 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c67550ae-ef09-4f96-b68f-fbd74024edfa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:48.947335 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c67550ae-ef09-4f96-b68f-fbd74024edfa tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1321 microversion: 2.1 time: 0.218134 Aug 19 15:23:48.948521 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 43/89] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:48 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:23:49.128271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ebe81001-d892-41d3-8a98-2bd01f177f48 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:49.129173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ebe81001-d892-41d3-8a98-2bd01f177f48 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:49.136986 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebe81001-d892-41d3-8a98-2bd01f177f48 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:49.137496 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebe81001-d892-41d3-8a98-2bd01f177f48 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:49.137932 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebe81001-d892-41d3-8a98-2bd01f177f48 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:49.138694 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebe81001-d892-41d3-8a98-2bd01f177f48 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:49.139155 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebe81001-d892-41d3-8a98-2bd01f177f48 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:49.139884 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebe81001-d892-41d3-8a98-2bd01f177f48 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:49.193625 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-851a5a3b-e407-4f5e-9790-ac2feb4e53b4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:49.194655 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-851a5a3b-e407-4f5e-9790-ac2feb4e53b4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:49.215340 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-851a5a3b-e407-4f5e-9790-ac2feb4e53b4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:49.216335 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-851a5a3b-e407-4f5e-9790-ac2feb4e53b4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:49.217327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-851a5a3b-e407-4f5e-9790-ac2feb4e53b4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:49.218809 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-851a5a3b-e407-4f5e-9790-ac2feb4e53b4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:49.220152 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-851a5a3b-e407-4f5e-9790-ac2feb4e53b4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:49.221113 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-851a5a3b-e407-4f5e-9790-ac2feb4e53b4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:49.483214 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ebe81001-d892-41d3-8a98-2bd01f177f48 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:49.491476 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ebe81001-d892-41d3-8a98-2bd01f177f48 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1367 microversion: 2.1 time: 0.367013 Aug 19 15:23:49.492082 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 47/90] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:49 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1367 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:49.514234 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-851a5a3b-e407-4f5e-9790-ac2feb4e53b4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:49.524023 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-851a5a3b-e407-4f5e-9790-ac2feb4e53b4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1363 microversion: 2.1 time: 0.336135 Aug 19 15:23:49.524876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 44/91] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:49 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:49.935192 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d4f25649-b1c4-4f0e-80e2-1a95d46144c4 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:49.936099 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d4f25649-b1c4-4f0e-80e2-1a95d46144c4 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:49.952493 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4f25649-b1c4-4f0e-80e2-1a95d46144c4 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:49.953421 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4f25649-b1c4-4f0e-80e2-1a95d46144c4 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:49.954059 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4f25649-b1c4-4f0e-80e2-1a95d46144c4 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:49.955874 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4f25649-b1c4-4f0e-80e2-1a95d46144c4 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:49.956701 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4f25649-b1c4-4f0e-80e2-1a95d46144c4 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:49.957621 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4f25649-b1c4-4f0e-80e2-1a95d46144c4 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:49.970486 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1748ca07-36ec-4d70-b657-34a81f757ba6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:49.971895 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1748ca07-36ec-4d70-b657-34a81f757ba6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:49.988156 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1748ca07-36ec-4d70-b657-34a81f757ba6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:49.988737 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1748ca07-36ec-4d70-b657-34a81f757ba6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:49.989496 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1748ca07-36ec-4d70-b657-34a81f757ba6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:49.990297 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1748ca07-36ec-4d70-b657-34a81f757ba6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:49.991904 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1748ca07-36ec-4d70-b657-34a81f757ba6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:49.992566 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1748ca07-36ec-4d70-b657-34a81f757ba6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:50.244906 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d4f25649-b1c4-4f0e-80e2-1a95d46144c4 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:50.257918 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1748ca07-36ec-4d70-b657-34a81f757ba6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:50.261240 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d4f25649-b1c4-4f0e-80e2-1a95d46144c4 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 0.331080 Aug 19 15:23:50.262865 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 48/92] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:49 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:50.278412 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1748ca07-36ec-4d70-b657-34a81f757ba6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1321 microversion: 2.1 time: 0.312323 Aug 19 15:23:50.279019 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 45/93] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:49 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:50.513849 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dd38675d-5dc3-455e-bc03-82de7da59d36 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:50.514823 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dd38675d-5dc3-455e-bc03-82de7da59d36 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:50.530893 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd38675d-5dc3-455e-bc03-82de7da59d36 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:50.533356 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd38675d-5dc3-455e-bc03-82de7da59d36 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:50.533777 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd38675d-5dc3-455e-bc03-82de7da59d36 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:50.535220 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd38675d-5dc3-455e-bc03-82de7da59d36 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:50.537624 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd38675d-5dc3-455e-bc03-82de7da59d36 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:50.538292 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd38675d-5dc3-455e-bc03-82de7da59d36 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:50.550065 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4ae77cb9-127d-446b-9fdd-66ecd903cb78 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:50.551217 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4ae77cb9-127d-446b-9fdd-66ecd903cb78 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:50.562882 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ae77cb9-127d-446b-9fdd-66ecd903cb78 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:50.563535 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ae77cb9-127d-446b-9fdd-66ecd903cb78 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:50.563998 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ae77cb9-127d-446b-9fdd-66ecd903cb78 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:50.567127 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ae77cb9-127d-446b-9fdd-66ecd903cb78 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:50.568594 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ae77cb9-127d-446b-9fdd-66ecd903cb78 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:50.570534 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ae77cb9-127d-446b-9fdd-66ecd903cb78 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:50.898583 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4ae77cb9-127d-446b-9fdd-66ecd903cb78 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:50.905806 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dd38675d-5dc3-455e-bc03-82de7da59d36 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:50.921227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4ae77cb9-127d-446b-9fdd-66ecd903cb78 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1363 microversion: 2.1 time: 0.375559 Aug 19 15:23:50.932718 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dd38675d-5dc3-455e-bc03-82de7da59d36 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1367 microversion: 2.1 time: 0.413037 Aug 19 15:23:50.933317 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 46/94] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:50 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1363 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:23:50.943694 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 49/95] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:50 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1367 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:51.283684 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e560c53a-fc52-4f5e-a25c-fe12607ca9e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:51.285057 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e560c53a-fc52-4f5e-a25c-fe12607ca9e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:51.300278 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-055907b4-b9f7-4342-94ac-7b582b7ecf3b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:51.301369 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-055907b4-b9f7-4342-94ac-7b582b7ecf3b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:51.312634 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e560c53a-fc52-4f5e-a25c-fe12607ca9e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:51.313304 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e560c53a-fc52-4f5e-a25c-fe12607ca9e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:51.313739 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e560c53a-fc52-4f5e-a25c-fe12607ca9e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:51.313889 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-055907b4-b9f7-4342-94ac-7b582b7ecf3b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:51.314506 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-055907b4-b9f7-4342-94ac-7b582b7ecf3b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:51.315382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e560c53a-fc52-4f5e-a25c-fe12607ca9e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:51.315973 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-055907b4-b9f7-4342-94ac-7b582b7ecf3b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:51.316705 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-055907b4-b9f7-4342-94ac-7b582b7ecf3b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:51.317418 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e560c53a-fc52-4f5e-a25c-fe12607ca9e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:51.317846 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e560c53a-fc52-4f5e-a25c-fe12607ca9e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:51.322897 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-055907b4-b9f7-4342-94ac-7b582b7ecf3b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:51.323654 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-055907b4-b9f7-4342-94ac-7b582b7ecf3b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:52.334606 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-055907b4-b9f7-4342-94ac-7b582b7ecf3b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:52.352090 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-055907b4-b9f7-4342-94ac-7b582b7ecf3b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1321 microversion: 2.1 time: 1.055576 Aug 19 15:23:52.357040 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 50/96] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:51 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1321 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:52.364289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ceeee678-e0ae-4b76-8aa3-0717f2ec7bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:52.365306 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ceeee678-e0ae-4b76-8aa3-0717f2ec7bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:52.367292 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e560c53a-fc52-4f5e-a25c-fe12607ca9e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:52.380643 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e560c53a-fc52-4f5e-a25c-fe12607ca9e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 1.100514 Aug 19 15:23:52.383159 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 47/97] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:51 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:52.389352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceeee678-e0ae-4b76-8aa3-0717f2ec7bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:52.392689 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceeee678-e0ae-4b76-8aa3-0717f2ec7bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:52.393389 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceeee678-e0ae-4b76-8aa3-0717f2ec7bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:52.394621 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-febead68-a9b9-40b4-a671-efe7744a8d8d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:52.395145 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceeee678-e0ae-4b76-8aa3-0717f2ec7bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:52.395864 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-febead68-a9b9-40b4-a671-efe7744a8d8d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:52.396096 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceeee678-e0ae-4b76-8aa3-0717f2ec7bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:52.396852 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceeee678-e0ae-4b76-8aa3-0717f2ec7bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:52.411955 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-febead68-a9b9-40b4-a671-efe7744a8d8d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:52.412473 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-febead68-a9b9-40b4-a671-efe7744a8d8d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:52.424930 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-febead68-a9b9-40b4-a671-efe7744a8d8d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:52.425998 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-febead68-a9b9-40b4-a671-efe7744a8d8d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:52.426906 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-febead68-a9b9-40b4-a671-efe7744a8d8d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:52.427516 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-febead68-a9b9-40b4-a671-efe7744a8d8d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:52.448555 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:52.917186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-febead68-a9b9-40b4-a671-efe7744a8d8d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:52.927902 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-febead68-a9b9-40b4-a671-efe7744a8d8d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1367 microversion: 2.1 time: 0.543457 Aug 19 15:23:52.933866 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 48/98] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:52 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1367 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:52.986947 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ceeee678-e0ae-4b76-8aa3-0717f2ec7bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:53.024103 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ceeee678-e0ae-4b76-8aa3-0717f2ec7bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1363 microversion: 2.1 time: 0.664802 Aug 19 15:23:53.026004 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 51/99] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:52 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1363 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:53.375753 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6f6d3c8f-dc44-42ca-8f7a-934bef8a55f6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:53.376480 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6f6d3c8f-dc44-42ca-8f7a-934bef8a55f6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:53.387815 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f6d3c8f-dc44-42ca-8f7a-934bef8a55f6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:53.388778 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f6d3c8f-dc44-42ca-8f7a-934bef8a55f6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:53.389479 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f6d3c8f-dc44-42ca-8f7a-934bef8a55f6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:53.390369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f6d3c8f-dc44-42ca-8f7a-934bef8a55f6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:53.390970 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f6d3c8f-dc44-42ca-8f7a-934bef8a55f6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:53.391585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f6d3c8f-dc44-42ca-8f7a-934bef8a55f6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:53.403001 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-06dc5499-ba9f-422b-a269-7ab6df211259 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:53.403723 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-06dc5499-ba9f-422b-a269-7ab6df211259 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:53.413568 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06dc5499-ba9f-422b-a269-7ab6df211259 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:53.417999 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06dc5499-ba9f-422b-a269-7ab6df211259 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:53.418530 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06dc5499-ba9f-422b-a269-7ab6df211259 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:53.419536 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06dc5499-ba9f-422b-a269-7ab6df211259 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:53.420202 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06dc5499-ba9f-422b-a269-7ab6df211259 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:53.427161 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06dc5499-ba9f-422b-a269-7ab6df211259 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:53.434571 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:53.771807 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6f6d3c8f-dc44-42ca-8f7a-934bef8a55f6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:53.791215 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6f6d3c8f-dc44-42ca-8f7a-934bef8a55f6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1321 microversion: 2.1 time: 0.416755 Aug 19 15:23:53.809226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 49/100] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:53 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1321 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:53.813503 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-06dc5499-ba9f-422b-a269-7ab6df211259 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:53.822493 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-06dc5499-ba9f-422b-a269-7ab6df211259 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 0.423107 Aug 19 15:23:53.823442 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 52/101] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:53 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:23:53.960940 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6547da07-3827-4fce-99c2-365a9bf1bc7b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:53.961917 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6547da07-3827-4fce-99c2-365a9bf1bc7b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:53.969970 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6547da07-3827-4fce-99c2-365a9bf1bc7b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:53.970478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6547da07-3827-4fce-99c2-365a9bf1bc7b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:53.970982 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6547da07-3827-4fce-99c2-365a9bf1bc7b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:53.971751 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6547da07-3827-4fce-99c2-365a9bf1bc7b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:53.972266 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6547da07-3827-4fce-99c2-365a9bf1bc7b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:53.972877 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6547da07-3827-4fce-99c2-365a9bf1bc7b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:54.063197 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b36bb443-e1c9-4f23-a6ff-90bdcf42593c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:54.063975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b36bb443-e1c9-4f23-a6ff-90bdcf42593c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:54.071022 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b36bb443-e1c9-4f23-a6ff-90bdcf42593c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:54.071582 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b36bb443-e1c9-4f23-a6ff-90bdcf42593c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:54.071949 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b36bb443-e1c9-4f23-a6ff-90bdcf42593c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:54.073300 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b36bb443-e1c9-4f23-a6ff-90bdcf42593c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:54.073829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b36bb443-e1c9-4f23-a6ff-90bdcf42593c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:54.074327 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b36bb443-e1c9-4f23-a6ff-90bdcf42593c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:54.265149 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6547da07-3827-4fce-99c2-365a9bf1bc7b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:54.273231 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6547da07-3827-4fce-99c2-365a9bf1bc7b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1367 microversion: 2.1 time: 0.316712 Aug 19 15:23:54.273567 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 50/102] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:53 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:54.329658 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b36bb443-e1c9-4f23-a6ff-90bdcf42593c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:54.349609 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b36bb443-e1c9-4f23-a6ff-90bdcf42593c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1363 microversion: 2.1 time: 0.289110 Aug 19 15:23:54.350978 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 53/103] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:54 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:23:54.815084 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-069c9974-7f90-4e5a-9d6e-18ae85b9f7bd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:54.819096 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-069c9974-7f90-4e5a-9d6e-18ae85b9f7bd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:54.843586 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-069c9974-7f90-4e5a-9d6e-18ae85b9f7bd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:54.844098 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-069c9974-7f90-4e5a-9d6e-18ae85b9f7bd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:54.847026 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ed1fe88b-c0b4-419b-a8df-f7217f11abbf tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:54.848284 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ed1fe88b-c0b4-419b-a8df-f7217f11abbf tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:54.848517 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-069c9974-7f90-4e5a-9d6e-18ae85b9f7bd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:54.850290 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-069c9974-7f90-4e5a-9d6e-18ae85b9f7bd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:54.851086 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-069c9974-7f90-4e5a-9d6e-18ae85b9f7bd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:54.851533 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-069c9974-7f90-4e5a-9d6e-18ae85b9f7bd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:54.865204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed1fe88b-c0b4-419b-a8df-f7217f11abbf tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:54.866515 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed1fe88b-c0b4-419b-a8df-f7217f11abbf tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:54.867610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed1fe88b-c0b4-419b-a8df-f7217f11abbf tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:54.869908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed1fe88b-c0b4-419b-a8df-f7217f11abbf tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:54.873760 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed1fe88b-c0b4-419b-a8df-f7217f11abbf tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:54.874323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed1fe88b-c0b4-419b-a8df-f7217f11abbf tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:55.160868 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:55.280230 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ed1fe88b-c0b4-419b-a8df-f7217f11abbf tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:55.286290 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-069c9974-7f90-4e5a-9d6e-18ae85b9f7bd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:55.305743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-069c9974-7f90-4e5a-9d6e-18ae85b9f7bd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1321 microversion: 2.1 time: 0.494329 Aug 19 15:23:55.310493 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ed1fe88b-c0b4-419b-a8df-f7217f11abbf tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 0.468382 Aug 19 15:23:55.325497 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 54/105] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:54 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:23:55.326005 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 51/105] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:54 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1321 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:55.332833 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6cde53d4-e488-40b1-bf0f-b8776f87f176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:55.333940 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6cde53d4-e488-40b1-bf0f-b8776f87f176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:55.343391 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cde53d4-e488-40b1-bf0f-b8776f87f176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:55.344071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cde53d4-e488-40b1-bf0f-b8776f87f176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:55.344715 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cde53d4-e488-40b1-bf0f-b8776f87f176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:55.345731 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cde53d4-e488-40b1-bf0f-b8776f87f176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:55.346414 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cde53d4-e488-40b1-bf0f-b8776f87f176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:55.347124 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cde53d4-e488-40b1-bf0f-b8776f87f176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:55.372277 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2769eafd-67c5-4c2b-9ed5-357b16e37f69 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:55.373174 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2769eafd-67c5-4c2b-9ed5-357b16e37f69 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:55.398127 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2769eafd-67c5-4c2b-9ed5-357b16e37f69 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:55.399398 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2769eafd-67c5-4c2b-9ed5-357b16e37f69 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:55.399925 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2769eafd-67c5-4c2b-9ed5-357b16e37f69 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:55.400729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2769eafd-67c5-4c2b-9ed5-357b16e37f69 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:55.407662 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2769eafd-67c5-4c2b-9ed5-357b16e37f69 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:55.415150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2769eafd-67c5-4c2b-9ed5-357b16e37f69 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:55.699719 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6cde53d4-e488-40b1-bf0f-b8776f87f176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:55.707033 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6cde53d4-e488-40b1-bf0f-b8776f87f176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1367 microversion: 2.1 time: 0.379816 Aug 19 15:23:55.708257 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 55/106] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:55 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:55.730746 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2769eafd-67c5-4c2b-9ed5-357b16e37f69 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:55.740371 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2769eafd-67c5-4c2b-9ed5-357b16e37f69 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1363 microversion: 2.1 time: 0.372647 Aug 19 15:23:55.741407 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 52/107] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:55 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1363 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:55.785582 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-fde8efc5-e4b1-49ba-83ac-eb4aecf4ec8c req-7c66852c-42d3-4333-8fa0-fcdb4d4a9c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ac8d32c-fd72-4373-8957-3e1698b2dd3c", "name": "network-vif-plugged", "status": "completed", "tag": "e851153e-06d0-452a-ac68-7efce3d3bf25"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:23:55.795942 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-fde8efc5-e4b1-49ba-83ac-eb4aecf4ec8c req-7c66852c-42d3-4333-8fa0-fcdb4d4a9c49 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:55.796917 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-fde8efc5-e4b1-49ba-83ac-eb4aecf4ec8c req-7c66852c-42d3-4333-8fa0-fcdb4d4a9c49 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:55.797493 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-fde8efc5-e4b1-49ba-83ac-eb4aecf4ec8c req-7c66852c-42d3-4333-8fa0-fcdb4d4a9c49 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:55.811922 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-fde8efc5-e4b1-49ba-83ac-eb4aecf4ec8c req-7c66852c-42d3-4333-8fa0-fcdb4d4a9c49 service nova] Creating event network-vif-plugged:e851153e-06d0-452a-ac68-7efce3d3bf25 for instance 9ac8d32c-fd72-4373-8957-3e1698b2dd3c on hv-cinder-83538 Aug 19 15:23:55.817714 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-fde8efc5-e4b1-49ba-83ac-eb4aecf4ec8c req-7c66852c-42d3-4333-8fa0-fcdb4d4a9c49 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107923 Aug 19 15:23:55.818324 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 56/108] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:23:56.331516 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-facd67dc-89ea-4550-8ff3-672877f38b6d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:56.332938 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-facd67dc-89ea-4550-8ff3-672877f38b6d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:56.343852 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0d0948d5-d0c1-4e93-b20d-01f6806c82eb tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:56.344742 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0d0948d5-d0c1-4e93-b20d-01f6806c82eb tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:56.347080 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-facd67dc-89ea-4550-8ff3-672877f38b6d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:56.348078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-facd67dc-89ea-4550-8ff3-672877f38b6d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:56.348846 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-facd67dc-89ea-4550-8ff3-672877f38b6d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:56.351181 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-facd67dc-89ea-4550-8ff3-672877f38b6d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:56.351913 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-facd67dc-89ea-4550-8ff3-672877f38b6d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:56.358796 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-facd67dc-89ea-4550-8ff3-672877f38b6d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:56.359331 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d0948d5-d0c1-4e93-b20d-01f6806c82eb tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:56.359851 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d0948d5-d0c1-4e93-b20d-01f6806c82eb tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:56.360289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d0948d5-d0c1-4e93-b20d-01f6806c82eb tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:56.361040 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d0948d5-d0c1-4e93-b20d-01f6806c82eb tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:56.361492 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d0948d5-d0c1-4e93-b20d-01f6806c82eb tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:56.361913 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d0948d5-d0c1-4e93-b20d-01f6806c82eb tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:56.709083 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0d0948d5-d0c1-4e93-b20d-01f6806c82eb tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:56.718370 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0d0948d5-d0c1-4e93-b20d-01f6806c82eb tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 0.380907 Aug 19 15:23:56.718963 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 57/109] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:56 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:56.732456 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8877abd7-4670-433b-a253-7df3f732c0df tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:56.736141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8877abd7-4670-433b-a253-7df3f732c0df tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:56.753216 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8877abd7-4670-433b-a253-7df3f732c0df tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:56.753216 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8877abd7-4670-433b-a253-7df3f732c0df tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:56.757572 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8877abd7-4670-433b-a253-7df3f732c0df tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:56.758851 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8877abd7-4670-433b-a253-7df3f732c0df tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:56.761697 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8877abd7-4670-433b-a253-7df3f732c0df tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:56.761697 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8877abd7-4670-433b-a253-7df3f732c0df tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:56.775586 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-facd67dc-89ea-4550-8ff3-672877f38b6d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:56.789561 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-facd67dc-89ea-4550-8ff3-672877f38b6d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1321 microversion: 2.1 time: 0.462096 Aug 19 15:23:56.790254 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 53/110] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:56 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1321 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:56.802209 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-22f68914-5ffd-412c-b283-0b71e6dc7e3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:56.804097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-22f68914-5ffd-412c-b283-0b71e6dc7e3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:56.818784 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22f68914-5ffd-412c-b283-0b71e6dc7e3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:56.819365 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22f68914-5ffd-412c-b283-0b71e6dc7e3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:56.821752 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22f68914-5ffd-412c-b283-0b71e6dc7e3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:56.823796 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22f68914-5ffd-412c-b283-0b71e6dc7e3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:56.823796 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22f68914-5ffd-412c-b283-0b71e6dc7e3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:56.837993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22f68914-5ffd-412c-b283-0b71e6dc7e3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:57.100331 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-22f68914-5ffd-412c-b283-0b71e6dc7e3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:57.109369 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8877abd7-4670-433b-a253-7df3f732c0df tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:57.113860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-22f68914-5ffd-412c-b283-0b71e6dc7e3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1363 microversion: 2.1 time: 0.318918 Aug 19 15:23:57.128772 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 54/111] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:56 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:57.131682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8877abd7-4670-433b-a253-7df3f732c0df tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1367 microversion: 2.1 time: 0.403242 Aug 19 15:23:57.132417 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 58/112] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:56 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1367 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:57.752021 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b8dc0fb5-aa55-41e1-8893-650900681d9a tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:57.752670 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b8dc0fb5-aa55-41e1-8893-650900681d9a tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:57.760002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8dc0fb5-aa55-41e1-8893-650900681d9a tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:57.761109 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8dc0fb5-aa55-41e1-8893-650900681d9a tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:57.761549 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8dc0fb5-aa55-41e1-8893-650900681d9a tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:57.762296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8dc0fb5-aa55-41e1-8893-650900681d9a tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:57.762796 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8dc0fb5-aa55-41e1-8893-650900681d9a tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:57.763248 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8dc0fb5-aa55-41e1-8893-650900681d9a tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:57.818011 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2c86b320-e42e-4345-aafa-dad8a4ba9ce5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:57.818724 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2c86b320-e42e-4345-aafa-dad8a4ba9ce5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:57.828378 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c86b320-e42e-4345-aafa-dad8a4ba9ce5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:57.829311 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c86b320-e42e-4345-aafa-dad8a4ba9ce5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:57.829966 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c86b320-e42e-4345-aafa-dad8a4ba9ce5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:57.830785 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c86b320-e42e-4345-aafa-dad8a4ba9ce5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:57.851705 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c86b320-e42e-4345-aafa-dad8a4ba9ce5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:57.860450 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c86b320-e42e-4345-aafa-dad8a4ba9ce5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:58.062064 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b8dc0fb5-aa55-41e1-8893-650900681d9a tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:58.074964 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b8dc0fb5-aa55-41e1-8893-650900681d9a tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 0.324910 Aug 19 15:23:58.089470 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 55/113] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:57 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:58.091899 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-33f9cbef-6800-4fc7-a4c8-52e1889c8f3a req-5d25d723-05ec-4cf3-b14d-7effd147188e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d", "name": "network-vif-plugged", "status": "completed", "tag": "489cb252-e00c-4932-b659-de93c87cfb6a"}, {"server_uuid": "903776c1-6779-4794-81e4-257cbfdb5908", "name": "network-vif-plugged", "status": "completed", "tag": "44c3f537-79e8-434b-8284-5ff8ab0dcb5c"}, {"server_uuid": "10c60ba0-a623-41bb-ba6c-e9ff6e6a4802", "name": "network-vif-plugged", "status": "completed", "tag": "b97f032a-18f2-4b4c-aa4a-57e19ac342cd"}, {"server_uuid": "c13d4563-5477-4605-9b1b-85113d779753", "name": "network-vif-plugged", "status": "completed", "tag": "02304f9d-f8e5-4fc7-8c86-f4b23da124da"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:23:58.145255 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-33f9cbef-6800-4fc7-a4c8-52e1889c8f3a req-5d25d723-05ec-4cf3-b14d-7effd147188e service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:58.145726 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-33f9cbef-6800-4fc7-a4c8-52e1889c8f3a req-5d25d723-05ec-4cf3-b14d-7effd147188e service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:58.151757 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-33f9cbef-6800-4fc7-a4c8-52e1889c8f3a req-5d25d723-05ec-4cf3-b14d-7effd147188e service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:58.168948 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2c86b320-e42e-4345-aafa-dad8a4ba9ce5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:58.186755 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2c86b320-e42e-4345-aafa-dad8a4ba9ce5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1321 microversion: 2.1 time: 0.372988 Aug 19 15:23:58.187348 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 59/114] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:57 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1321 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:23:58.200844 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-33f9cbef-6800-4fc7-a4c8-52e1889c8f3a req-5d25d723-05ec-4cf3-b14d-7effd147188e service nova] Creating event network-vif-plugged:489cb252-e00c-4932-b659-de93c87cfb6a for instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d on hv-cinder-83538 Aug 19 15:23:58.201352 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-33f9cbef-6800-4fc7-a4c8-52e1889c8f3a req-5d25d723-05ec-4cf3-b14d-7effd147188e service nova] Creating event network-vif-plugged:44c3f537-79e8-434b-8284-5ff8ab0dcb5c for instance 903776c1-6779-4794-81e4-257cbfdb5908 on hv-cinder-83538 Aug 19 15:23:58.201888 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-33f9cbef-6800-4fc7-a4c8-52e1889c8f3a req-5d25d723-05ec-4cf3-b14d-7effd147188e service nova] Creating event network-vif-plugged:b97f032a-18f2-4b4c-aa4a-57e19ac342cd for instance 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 on hv-cinder-83538 Aug 19 15:23:58.202375 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-33f9cbef-6800-4fc7-a4c8-52e1889c8f3a req-5d25d723-05ec-4cf3-b14d-7effd147188e service nova] Creating event network-vif-plugged:02304f9d-f8e5-4fc7-8c86-f4b23da124da for instance c13d4563-5477-4605-9b1b-85113d779753 on hv-cinder-83538 Aug 19 15:23:58.212815 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c893a5b9-0ec4-4845-af8b-a5cef09d72cd tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:58.214147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c893a5b9-0ec4-4845-af8b-a5cef09d72cd tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:58.216357 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-33f9cbef-6800-4fc7-a4c8-52e1889c8f3a req-5d25d723-05ec-4cf3-b14d-7effd147188e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.137158 Aug 19 15:23:58.217997 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 56/115] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:23:58.225347 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-551f879c-68e8-46ac-ad70-99044425118c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:58.226356 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-551f879c-68e8-46ac-ad70-99044425118c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:58.231609 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c893a5b9-0ec4-4845-af8b-a5cef09d72cd tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:58.232101 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c893a5b9-0ec4-4845-af8b-a5cef09d72cd tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:58.232566 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c893a5b9-0ec4-4845-af8b-a5cef09d72cd tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:58.235491 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-551f879c-68e8-46ac-ad70-99044425118c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:58.236181 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-551f879c-68e8-46ac-ad70-99044425118c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:58.236788 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-551f879c-68e8-46ac-ad70-99044425118c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:58.238109 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c893a5b9-0ec4-4845-af8b-a5cef09d72cd tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:58.238574 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c893a5b9-0ec4-4845-af8b-a5cef09d72cd tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:58.239070 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c893a5b9-0ec4-4845-af8b-a5cef09d72cd tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:58.267733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-551f879c-68e8-46ac-ad70-99044425118c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:58.268296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-551f879c-68e8-46ac-ad70-99044425118c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:58.268776 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-551f879c-68e8-46ac-ad70-99044425118c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:58.601747 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c893a5b9-0ec4-4845-af8b-a5cef09d72cd tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:58.612129 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c893a5b9-0ec4-4845-af8b-a5cef09d72cd tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1363 microversion: 2.1 time: 0.409908 Aug 19 15:23:58.613745 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 60/116] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:58 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1363 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:58.667018 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-551f879c-68e8-46ac-ad70-99044425118c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:58.691462 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-551f879c-68e8-46ac-ad70-99044425118c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1367 microversion: 2.1 time: 0.471929 Aug 19 15:23:58.692348 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 57/117] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:58 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1367 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:59.095571 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-036e421b-f3b3-4638-8dfe-464773a8e331 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:59.096810 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-036e421b-f3b3-4638-8dfe-464773a8e331 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:59.111115 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-036e421b-f3b3-4638-8dfe-464773a8e331 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:59.112040 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-036e421b-f3b3-4638-8dfe-464773a8e331 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:59.115179 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-036e421b-f3b3-4638-8dfe-464773a8e331 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:59.116137 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-036e421b-f3b3-4638-8dfe-464773a8e331 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:59.123760 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-036e421b-f3b3-4638-8dfe-464773a8e331 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:59.124950 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-036e421b-f3b3-4638-8dfe-464773a8e331 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:59.207928 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6a931335-b163-4a94-a1ba-576fe087135f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:59.208625 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6a931335-b163-4a94-a1ba-576fe087135f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:59.222161 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a931335-b163-4a94-a1ba-576fe087135f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:59.222161 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a931335-b163-4a94-a1ba-576fe087135f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:59.222161 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a931335-b163-4a94-a1ba-576fe087135f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:59.222569 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a931335-b163-4a94-a1ba-576fe087135f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:59.223247 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a931335-b163-4a94-a1ba-576fe087135f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:59.223875 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a931335-b163-4a94-a1ba-576fe087135f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:59.650233 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-036e421b-f3b3-4638-8dfe-464773a8e331 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:59.662771 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-036e421b-f3b3-4638-8dfe-464773a8e331 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 0.571185 Aug 19 15:23:59.664362 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 61/118] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:59 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:59.668183 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6a931335-b163-4a94-a1ba-576fe087135f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:59.671689 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36dc56bb-f196-486f-ad32-706dfec68ca5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:59.672618 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36dc56bb-f196-486f-ad32-706dfec68ca5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:59.680654 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36dc56bb-f196-486f-ad32-706dfec68ca5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:59.681437 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36dc56bb-f196-486f-ad32-706dfec68ca5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:59.682192 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36dc56bb-f196-486f-ad32-706dfec68ca5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:59.683923 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36dc56bb-f196-486f-ad32-706dfec68ca5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:59.684638 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36dc56bb-f196-486f-ad32-706dfec68ca5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:59.685494 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36dc56bb-f196-486f-ad32-706dfec68ca5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:59.686440 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6a931335-b163-4a94-a1ba-576fe087135f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1515 microversion: 2.1 time: 0.482520 Aug 19 15:23:59.689428 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 58/119] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:59 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1515 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:23:59.708287 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3f0ee08f-4e27-4d15-b674-12d548df3a83 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:23:59.712452 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3f0ee08f-4e27-4d15-b674-12d548df3a83 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:59.727428 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f0ee08f-4e27-4d15-b674-12d548df3a83 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:59.728202 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f0ee08f-4e27-4d15-b674-12d548df3a83 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:59.728310 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f0ee08f-4e27-4d15-b674-12d548df3a83 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:59.730131 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f0ee08f-4e27-4d15-b674-12d548df3a83 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:59.730779 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f0ee08f-4e27-4d15-b674-12d548df3a83 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:59.731380 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f0ee08f-4e27-4d15-b674-12d548df3a83 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:59.835310 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-3f0ee08f-4e27-4d15-b674-12d548df3a83 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lazy-loading 'flavor' on Instance uuid 9ac8d32c-fd72-4373-8957-3e1698b2dd3c {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:23:59.910761 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-36dc56bb-f196-486f-ad32-706dfec68ca5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:23:59.927745 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36dc56bb-f196-486f-ad32-706dfec68ca5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1363 microversion: 2.1 time: 0.261728 Aug 19 15:23:59.945205 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 62/120] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:59 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:23:59.954487 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-42c52bd4-3368-404c-9310-f79c76033214 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:23:59.955437 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-42c52bd4-3368-404c-9310-f79c76033214 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:23:59.963472 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42c52bd4-3368-404c-9310-f79c76033214 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:59.964433 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42c52bd4-3368-404c-9310-f79c76033214 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:59.965352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42c52bd4-3368-404c-9310-f79c76033214 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:23:59.967246 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42c52bd4-3368-404c-9310-f79c76033214 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:23:59.967927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42c52bd4-3368-404c-9310-f79c76033214 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:23:59.968531 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42c52bd4-3368-404c-9310-f79c76033214 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:00.015012 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3f0ee08f-4e27-4d15-b674-12d548df3a83 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "POST /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c/action" status: 200 len: 32 microversion: 2.1 time: 0.310545 Aug 19 15:24:00.016065 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 59/121] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Aug 19 15:23:59 2022] POST /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c/action => generated 32 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 15:24:00.031625 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5a3a0ac9-2674-49ca-ad82-ad6aa0c1d6ed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:00.032629 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5a3a0ac9-2674-49ca-ad82-ad6aa0c1d6ed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:00.041294 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a3a0ac9-2674-49ca-ad82-ad6aa0c1d6ed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:00.043008 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a3a0ac9-2674-49ca-ad82-ad6aa0c1d6ed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:00.043644 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a3a0ac9-2674-49ca-ad82-ad6aa0c1d6ed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:00.044580 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a3a0ac9-2674-49ca-ad82-ad6aa0c1d6ed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:00.045398 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a3a0ac9-2674-49ca-ad82-ad6aa0c1d6ed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:00.045969 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a3a0ac9-2674-49ca-ad82-ad6aa0c1d6ed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:00.197522 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-42c52bd4-3368-404c-9310-f79c76033214 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:00.210329 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-42c52bd4-3368-404c-9310-f79c76033214 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1367 microversion: 2.1 time: 0.263672 Aug 19 15:24:00.213950 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 63/122] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:23:59 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:00.286679 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5a3a0ac9-2674-49ca-ad82-ad6aa0c1d6ed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:00.296002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5a3a0ac9-2674-49ca-ad82-ad6aa0c1d6ed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.269042 Aug 19 15:24:00.310370 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 60/123] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:00 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:00.706987 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6a3407b3-2908-4950-91b0-8a959bd8e610 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:00.707798 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6a3407b3-2908-4950-91b0-8a959bd8e610 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:00.721100 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a3407b3-2908-4950-91b0-8a959bd8e610 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:00.721711 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a3407b3-2908-4950-91b0-8a959bd8e610 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:00.722363 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a3407b3-2908-4950-91b0-8a959bd8e610 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:00.723683 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a3407b3-2908-4950-91b0-8a959bd8e610 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:00.724206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a3407b3-2908-4950-91b0-8a959bd8e610 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:00.725125 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a3407b3-2908-4950-91b0-8a959bd8e610 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:00.887479 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6a3407b3-2908-4950-91b0-8a959bd8e610 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:00.896620 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6a3407b3-2908-4950-91b0-8a959bd8e610 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1315 microversion: 2.1 time: 0.196159 Aug 19 15:24:00.897587 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 64/124] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:00 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:00.960288 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e8b48f4e-dde5-4935-b6b4-f80a2db830c1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:00.960958 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e8b48f4e-dde5-4935-b6b4-f80a2db830c1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:00.968164 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8b48f4e-dde5-4935-b6b4-f80a2db830c1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:00.968679 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8b48f4e-dde5-4935-b6b4-f80a2db830c1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:00.969144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8b48f4e-dde5-4935-b6b4-f80a2db830c1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:00.969852 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8b48f4e-dde5-4935-b6b4-f80a2db830c1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:00.970299 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8b48f4e-dde5-4935-b6b4-f80a2db830c1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:00.970717 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8b48f4e-dde5-4935-b6b4-f80a2db830c1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:01.124420 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e8b48f4e-dde5-4935-b6b4-f80a2db830c1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:01.133621 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e8b48f4e-dde5-4935-b6b4-f80a2db830c1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1363 microversion: 2.1 time: 0.177685 Aug 19 15:24:01.134211 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 61/125] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:00 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:01.234807 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bbc3be30-f173-498e-97f3-3b0974aa12b3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:01.235418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bbc3be30-f173-498e-97f3-3b0974aa12b3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:01.243091 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbc3be30-f173-498e-97f3-3b0974aa12b3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:01.243954 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbc3be30-f173-498e-97f3-3b0974aa12b3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:01.244709 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbc3be30-f173-498e-97f3-3b0974aa12b3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:01.255216 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbc3be30-f173-498e-97f3-3b0974aa12b3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:01.255753 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbc3be30-f173-498e-97f3-3b0974aa12b3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:01.256196 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbc3be30-f173-498e-97f3-3b0974aa12b3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:01.319020 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6e0b4f3b-2dfe-438d-9f91-622f420857b0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:01.320464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6e0b4f3b-2dfe-438d-9f91-622f420857b0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:01.331567 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e0b4f3b-2dfe-438d-9f91-622f420857b0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:01.332062 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e0b4f3b-2dfe-438d-9f91-622f420857b0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:01.332783 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e0b4f3b-2dfe-438d-9f91-622f420857b0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:01.337637 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e0b4f3b-2dfe-438d-9f91-622f420857b0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:01.338218 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e0b4f3b-2dfe-438d-9f91-622f420857b0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:01.338571 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e0b4f3b-2dfe-438d-9f91-622f420857b0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:01.503554 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bbc3be30-f173-498e-97f3-3b0974aa12b3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:01.518312 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bbc3be30-f173-498e-97f3-3b0974aa12b3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1367 microversion: 2.1 time: 0.287078 Aug 19 15:24:01.532555 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 65/126] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:01 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:01.586889 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6e0b4f3b-2dfe-438d-9f91-622f420857b0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:01.595187 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6e0b4f3b-2dfe-438d-9f91-622f420857b0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.280754 Aug 19 15:24:01.595779 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 62/127] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:01 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:01.922888 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a11efb08-bc6a-4688-b3a9-85d8767cd0c5 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:01.924146 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a11efb08-bc6a-4688-b3a9-85d8767cd0c5 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:01.931579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a11efb08-bc6a-4688-b3a9-85d8767cd0c5 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:01.932710 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a11efb08-bc6a-4688-b3a9-85d8767cd0c5 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:01.933563 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a11efb08-bc6a-4688-b3a9-85d8767cd0c5 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:01.934601 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a11efb08-bc6a-4688-b3a9-85d8767cd0c5 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:01.935154 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a11efb08-bc6a-4688-b3a9-85d8767cd0c5 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:01.935861 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a11efb08-bc6a-4688-b3a9-85d8767cd0c5 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:02.101232 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a11efb08-bc6a-4688-b3a9-85d8767cd0c5 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:02.109675 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a11efb08-bc6a-4688-b3a9-85d8767cd0c5 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1501 microversion: 2.1 time: 0.190738 Aug 19 15:24:02.110391 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 66/128] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:01 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1501 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:02.160182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1cd67d82-8f85-4df2-9baf-3ac390c43939 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:02.161562 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1cd67d82-8f85-4df2-9baf-3ac390c43939 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:02.169443 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cd67d82-8f85-4df2-9baf-3ac390c43939 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:02.170106 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cd67d82-8f85-4df2-9baf-3ac390c43939 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:02.170746 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cd67d82-8f85-4df2-9baf-3ac390c43939 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:02.171646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cd67d82-8f85-4df2-9baf-3ac390c43939 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:02.172119 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cd67d82-8f85-4df2-9baf-3ac390c43939 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:02.172632 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cd67d82-8f85-4df2-9baf-3ac390c43939 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:02.552639 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cb768798-c13c-4297-af38-d61ae1db5de4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:02.553256 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cb768798-c13c-4297-af38-d61ae1db5de4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:02.561523 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb768798-c13c-4297-af38-d61ae1db5de4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:02.562007 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb768798-c13c-4297-af38-d61ae1db5de4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:02.562611 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb768798-c13c-4297-af38-d61ae1db5de4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:02.563308 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb768798-c13c-4297-af38-d61ae1db5de4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:02.563816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb768798-c13c-4297-af38-d61ae1db5de4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:02.564256 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb768798-c13c-4297-af38-d61ae1db5de4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:02.565393 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1cd67d82-8f85-4df2-9baf-3ac390c43939 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:02.576677 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1cd67d82-8f85-4df2-9baf-3ac390c43939 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1363 microversion: 2.1 time: 0.424458 Aug 19 15:24:02.578046 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 63/129] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:02 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1363 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:02.622836 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-35397a28-fdb8-44a7-813f-8835f44672d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:02.623937 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-35397a28-fdb8-44a7-813f-8835f44672d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:02.633139 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35397a28-fdb8-44a7-813f-8835f44672d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:02.633963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35397a28-fdb8-44a7-813f-8835f44672d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:02.634714 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35397a28-fdb8-44a7-813f-8835f44672d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:02.636520 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35397a28-fdb8-44a7-813f-8835f44672d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:02.637347 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35397a28-fdb8-44a7-813f-8835f44672d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:02.638117 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35397a28-fdb8-44a7-813f-8835f44672d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:02.793718 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cb768798-c13c-4297-af38-d61ae1db5de4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:02.801350 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cb768798-c13c-4297-af38-d61ae1db5de4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1558 microversion: 2.1 time: 0.252605 Aug 19 15:24:02.802000 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 67/130] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:02 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1558 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:02.823911 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-35397a28-fdb8-44a7-813f-8835f44672d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:02.827697 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:02.834163 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-35397a28-fdb8-44a7-813f-8835f44672d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.219153 Aug 19 15:24:02.835011 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 64/131] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:02 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:02.838787 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4945f697-acb5-4235-b9cb-39a3435e03fb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:02.839471 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4945f697-acb5-4235-b9cb-39a3435e03fb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:02.847504 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4945f697-acb5-4235-b9cb-39a3435e03fb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:02.848297 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4945f697-acb5-4235-b9cb-39a3435e03fb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:02.849156 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4945f697-acb5-4235-b9cb-39a3435e03fb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:02.850283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4945f697-acb5-4235-b9cb-39a3435e03fb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:02.850912 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4945f697-acb5-4235-b9cb-39a3435e03fb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:02.851654 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4945f697-acb5-4235-b9cb-39a3435e03fb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:02.939284 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:03.041175 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4945f697-acb5-4235-b9cb-39a3435e03fb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.220864 Aug 19 15:24:03.042613 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 68/132] 10.222.0.75 () {58 vars in 1275 bytes} [Fri Aug 19 15:24:02 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753/os-interface => generated 285 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:24:03.625479 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a24f1a97-6897-4392-94cc-f7230cca11d5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:03.626173 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a24f1a97-6897-4392-94cc-f7230cca11d5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:03.629876 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2c4a767d-bd18-494a-971e-484aa0e752e3 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c95947eb-4aba-4f1e-9c42-4977563a21d9"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:24:03.633420 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a24f1a97-6897-4392-94cc-f7230cca11d5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:03.634148 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a24f1a97-6897-4392-94cc-f7230cca11d5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:03.634358 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2c4a767d-bd18-494a-971e-484aa0e752e3 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:03.634876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a24f1a97-6897-4392-94cc-f7230cca11d5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:03.637102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a24f1a97-6897-4392-94cc-f7230cca11d5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:03.637895 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a24f1a97-6897-4392-94cc-f7230cca11d5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:03.638473 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a24f1a97-6897-4392-94cc-f7230cca11d5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:03.643020 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c4a767d-bd18-494a-971e-484aa0e752e3 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:03.644054 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c4a767d-bd18-494a-971e-484aa0e752e3 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:03.644671 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c4a767d-bd18-494a-971e-484aa0e752e3 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:03.645607 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c4a767d-bd18-494a-971e-484aa0e752e3 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:03.646276 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c4a767d-bd18-494a-971e-484aa0e752e3 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:03.646836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c4a767d-bd18-494a-971e-484aa0e752e3 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:03.828073 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a24f1a97-6897-4392-94cc-f7230cca11d5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:03.836958 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a24f1a97-6897-4392-94cc-f7230cca11d5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1549 microversion: 2.1 time: 0.241262 Aug 19 15:24:03.847151 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 65/133] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:03 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1549 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:24:03.863056 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4d538321-0a47-46d9-8a5a-5c2512457213 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:03.863669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4d538321-0a47-46d9-8a5a-5c2512457213 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:03.872481 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d538321-0a47-46d9-8a5a-5c2512457213 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:03.874126 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d538321-0a47-46d9-8a5a-5c2512457213 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:03.874578 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d538321-0a47-46d9-8a5a-5c2512457213 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:03.875297 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d538321-0a47-46d9-8a5a-5c2512457213 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:03.875744 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d538321-0a47-46d9-8a5a-5c2512457213 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:03.876172 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d538321-0a47-46d9-8a5a-5c2512457213 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:04.037127 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4d538321-0a47-46d9-8a5a-5c2512457213 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:04.054427 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4d538321-0a47-46d9-8a5a-5c2512457213 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.195097 Aug 19 15:24:04.055165 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 66/134] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:03 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:04.060850 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-da28dbc9-aff8-4074-bb99-5fd9a78f62fb tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:04.061593 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-da28dbc9-aff8-4074-bb99-5fd9a78f62fb tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:04.068125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da28dbc9-aff8-4074-bb99-5fd9a78f62fb tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:04.068623 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da28dbc9-aff8-4074-bb99-5fd9a78f62fb tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:04.069212 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da28dbc9-aff8-4074-bb99-5fd9a78f62fb tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:04.069897 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da28dbc9-aff8-4074-bb99-5fd9a78f62fb tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:04.070340 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da28dbc9-aff8-4074-bb99-5fd9a78f62fb tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:04.070752 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da28dbc9-aff8-4074-bb99-5fd9a78f62fb tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:04.166126 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-da28dbc9-aff8-4074-bb99-5fd9a78f62fb tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109623 Aug 19 15:24:04.167345 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 67/135] 10.222.0.75 () {58 vars in 1275 bytes} [Fri Aug 19 15:24:04 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:24:04.850335 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-3c112bbc-3d87-40b5-8834-f0bf2ea45674 req-e1bdac51-8d59-49fd-a653-6fcb27f7568a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13d4563-5477-4605-9b1b-85113d779753", "tag": "02304f9d-f8e5-4fc7-8c86-f4b23da124da"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:24:04.873163 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3c112bbc-3d87-40b5-8834-f0bf2ea45674 req-e1bdac51-8d59-49fd-a653-6fcb27f7568a service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:04.873895 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3c112bbc-3d87-40b5-8834-f0bf2ea45674 req-e1bdac51-8d59-49fd-a653-6fcb27f7568a service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:04.876989 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3c112bbc-3d87-40b5-8834-f0bf2ea45674 req-e1bdac51-8d59-49fd-a653-6fcb27f7568a service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:04.914996 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-3c112bbc-3d87-40b5-8834-f0bf2ea45674 req-e1bdac51-8d59-49fd-a653-6fcb27f7568a service nova] Creating event network-changed:02304f9d-f8e5-4fc7-8c86-f4b23da124da for instance c13d4563-5477-4605-9b1b-85113d779753 on hv-cinder-83538 Aug 19 15:24:04.927318 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-3c112bbc-3d87-40b5-8834-f0bf2ea45674 req-e1bdac51-8d59-49fd-a653-6fcb27f7568a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079450 Aug 19 15:24:04.929937 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 68/136] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:24:05.086385 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a43470db-0407-4aa9-9e8a-56b985cc4c56 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:05.087102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a43470db-0407-4aa9-9e8a-56b985cc4c56 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:05.111989 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a43470db-0407-4aa9-9e8a-56b985cc4c56 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:05.112919 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a43470db-0407-4aa9-9e8a-56b985cc4c56 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:05.113704 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a43470db-0407-4aa9-9e8a-56b985cc4c56 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:05.115003 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a43470db-0407-4aa9-9e8a-56b985cc4c56 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:05.116708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a43470db-0407-4aa9-9e8a-56b985cc4c56 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:05.117391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a43470db-0407-4aa9-9e8a-56b985cc4c56 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:05.565351 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a43470db-0407-4aa9-9e8a-56b985cc4c56 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:05.579841 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a43470db-0407-4aa9-9e8a-56b985cc4c56 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.507132 Aug 19 15:24:05.581802 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 69/137] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:05 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:06.285230 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-78264639-aa8d-4e6f-9529-8c1c72b41bfc req-1ff60bba-4571-425f-9a22-37cc5c4c6515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d", "tag": "489cb252-e00c-4932-b659-de93c87cfb6a"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:24:06.305854 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-78264639-aa8d-4e6f-9529-8c1c72b41bfc req-1ff60bba-4571-425f-9a22-37cc5c4c6515 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:06.306347 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-78264639-aa8d-4e6f-9529-8c1c72b41bfc req-1ff60bba-4571-425f-9a22-37cc5c4c6515 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:06.306771 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-78264639-aa8d-4e6f-9529-8c1c72b41bfc req-1ff60bba-4571-425f-9a22-37cc5c4c6515 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:06.339215 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-78264639-aa8d-4e6f-9529-8c1c72b41bfc req-1ff60bba-4571-425f-9a22-37cc5c4c6515 service nova] Creating event network-changed:489cb252-e00c-4932-b659-de93c87cfb6a for instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d on hv-cinder-83538 Aug 19 15:24:06.344283 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-78264639-aa8d-4e6f-9529-8c1c72b41bfc req-1ff60bba-4571-425f-9a22-37cc5c4c6515 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063023 Aug 19 15:24:06.363262 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 70/138] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:24:06.602921 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f4b6aa17-226b-4a6a-86fb-61c9fe6f965e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:06.603526 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f4b6aa17-226b-4a6a-86fb-61c9fe6f965e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:06.613823 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4b6aa17-226b-4a6a-86fb-61c9fe6f965e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:06.614362 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4b6aa17-226b-4a6a-86fb-61c9fe6f965e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:06.614775 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4b6aa17-226b-4a6a-86fb-61c9fe6f965e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:06.615583 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4b6aa17-226b-4a6a-86fb-61c9fe6f965e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:06.615961 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4b6aa17-226b-4a6a-86fb-61c9fe6f965e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:06.616378 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4b6aa17-226b-4a6a-86fb-61c9fe6f965e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:06.954752 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f4b6aa17-226b-4a6a-86fb-61c9fe6f965e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:06.962640 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f4b6aa17-226b-4a6a-86fb-61c9fe6f965e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.363889 Aug 19 15:24:06.963597 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 71/139] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:06 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:24:07.983092 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7b32455b-5713-4c6f-985f-1fcddd916e89 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:07.984509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7b32455b-5713-4c6f-985f-1fcddd916e89 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:07.987215 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=85 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:08.008183 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b32455b-5713-4c6f-985f-1fcddd916e89 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:08.008915 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b32455b-5713-4c6f-985f-1fcddd916e89 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:08.009758 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b32455b-5713-4c6f-985f-1fcddd916e89 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:08.011200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b32455b-5713-4c6f-985f-1fcddd916e89 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:08.011976 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b32455b-5713-4c6f-985f-1fcddd916e89 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:08.012768 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b32455b-5713-4c6f-985f-1fcddd916e89 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:08.190333 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7b32455b-5713-4c6f-985f-1fcddd916e89 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:08.198649 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7b32455b-5713-4c6f-985f-1fcddd916e89 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.219282 Aug 19 15:24:08.199179 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 72/140] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:07 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:24:09.219438 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3d3f42a2-b85b-4ffd-9ede-4c02061eb086 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:09.220113 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3d3f42a2-b85b-4ffd-9ede-4c02061eb086 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:09.227090 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d3f42a2-b85b-4ffd-9ede-4c02061eb086 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:09.227935 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d3f42a2-b85b-4ffd-9ede-4c02061eb086 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:09.228492 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d3f42a2-b85b-4ffd-9ede-4c02061eb086 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:09.229741 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d3f42a2-b85b-4ffd-9ede-4c02061eb086 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:09.230200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d3f42a2-b85b-4ffd-9ede-4c02061eb086 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:09.230676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d3f42a2-b85b-4ffd-9ede-4c02061eb086 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:09.377805 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3d3f42a2-b85b-4ffd-9ede-4c02061eb086 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:09.385879 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3d3f42a2-b85b-4ffd-9ede-4c02061eb086 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.170342 Aug 19 15:24:09.386471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 73/141] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:09 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:10.406598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b265155c-8477-4fa9-8dbc-9dd07a025835 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:10.407393 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b265155c-8477-4fa9-8dbc-9dd07a025835 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:10.413457 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b265155c-8477-4fa9-8dbc-9dd07a025835 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:10.413932 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b265155c-8477-4fa9-8dbc-9dd07a025835 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:10.414360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b265155c-8477-4fa9-8dbc-9dd07a025835 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:10.415048 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b265155c-8477-4fa9-8dbc-9dd07a025835 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:10.415495 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b265155c-8477-4fa9-8dbc-9dd07a025835 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:10.416168 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b265155c-8477-4fa9-8dbc-9dd07a025835 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:10.684132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b265155c-8477-4fa9-8dbc-9dd07a025835 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:10.701543 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b265155c-8477-4fa9-8dbc-9dd07a025835 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.298693 Aug 19 15:24:10.703490 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 74/142] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:10 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:24:10.738837 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2c4a767d-bd18-494a-971e-484aa0e752e3 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "POST /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.114901 Aug 19 15:24:10.739812 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 69/143] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Aug 19 15:24:03 2022] POST /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908/os-volume_attachments => generated 194 bytes in 7117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:24:11.730975 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2b20a542-2639-4059-9d20-be52f907828a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:11.732492 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2b20a542-2639-4059-9d20-be52f907828a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:11.744120 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b20a542-2639-4059-9d20-be52f907828a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:11.744690 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b20a542-2639-4059-9d20-be52f907828a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:11.747611 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b20a542-2639-4059-9d20-be52f907828a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:11.748768 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b20a542-2639-4059-9d20-be52f907828a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:11.749441 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b20a542-2639-4059-9d20-be52f907828a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:11.750381 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b20a542-2639-4059-9d20-be52f907828a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:11.940730 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2b20a542-2639-4059-9d20-be52f907828a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:11.952459 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2b20a542-2639-4059-9d20-be52f907828a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.228195 Aug 19 15:24:11.953525 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 75/144] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:11 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:12.976615 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eebbdcb1-8a9d-4e6d-9d42-c416d2279ee3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:12.977244 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eebbdcb1-8a9d-4e6d-9d42-c416d2279ee3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:12.979399 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=74 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:12.985453 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eebbdcb1-8a9d-4e6d-9d42-c416d2279ee3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:12.985939 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eebbdcb1-8a9d-4e6d-9d42-c416d2279ee3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:12.986362 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eebbdcb1-8a9d-4e6d-9d42-c416d2279ee3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:12.987044 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eebbdcb1-8a9d-4e6d-9d42-c416d2279ee3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:12.987485 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eebbdcb1-8a9d-4e6d-9d42-c416d2279ee3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:12.987896 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eebbdcb1-8a9d-4e6d-9d42-c416d2279ee3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:13.158232 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eebbdcb1-8a9d-4e6d-9d42-c416d2279ee3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:13.169878 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eebbdcb1-8a9d-4e6d-9d42-c416d2279ee3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.198178 Aug 19 15:24:13.170988 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 70/145] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:12 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:24:14.191967 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8d585f32-2fb5-48ea-9c23-3f7784e65f37 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:14.192717 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8d585f32-2fb5-48ea-9c23-3f7784e65f37 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:14.199160 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d585f32-2fb5-48ea-9c23-3f7784e65f37 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:14.199645 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d585f32-2fb5-48ea-9c23-3f7784e65f37 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:14.200082 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d585f32-2fb5-48ea-9c23-3f7784e65f37 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:14.201338 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d585f32-2fb5-48ea-9c23-3f7784e65f37 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:14.201782 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d585f32-2fb5-48ea-9c23-3f7784e65f37 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:14.202204 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d585f32-2fb5-48ea-9c23-3f7784e65f37 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:14.351584 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8d585f32-2fb5-48ea-9c23-3f7784e65f37 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:14.360120 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8d585f32-2fb5-48ea-9c23-3f7784e65f37 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.171817 Aug 19 15:24:14.360997 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 76/146] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:14 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:15.383319 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fbc95b6f-7d51-46e4-9e80-9aef2f1b78fb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:15.384967 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fbc95b6f-7d51-46e4-9e80-9aef2f1b78fb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:15.397785 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbc95b6f-7d51-46e4-9e80-9aef2f1b78fb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:15.398440 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbc95b6f-7d51-46e4-9e80-9aef2f1b78fb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:15.399052 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbc95b6f-7d51-46e4-9e80-9aef2f1b78fb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:15.399907 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbc95b6f-7d51-46e4-9e80-9aef2f1b78fb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:15.401078 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbc95b6f-7d51-46e4-9e80-9aef2f1b78fb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:15.401703 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbc95b6f-7d51-46e4-9e80-9aef2f1b78fb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:15.583438 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fbc95b6f-7d51-46e4-9e80-9aef2f1b78fb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:15.592042 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fbc95b6f-7d51-46e4-9e80-9aef2f1b78fb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.213020 Aug 19 15:24:15.592898 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 71/147] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:15 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:16.612871 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7ca373cd-c446-47dc-bf92-02966609e638 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:16.613463 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7ca373cd-c446-47dc-bf92-02966609e638 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:16.619905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ca373cd-c446-47dc-bf92-02966609e638 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:16.620496 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ca373cd-c446-47dc-bf92-02966609e638 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:16.620986 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ca373cd-c446-47dc-bf92-02966609e638 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:16.621782 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ca373cd-c446-47dc-bf92-02966609e638 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:16.622246 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ca373cd-c446-47dc-bf92-02966609e638 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:16.622666 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ca373cd-c446-47dc-bf92-02966609e638 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:16.794661 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7ca373cd-c446-47dc-bf92-02966609e638 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:16.803769 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7ca373cd-c446-47dc-bf92-02966609e638 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.194618 Aug 19 15:24:16.804351 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 77/148] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:16 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:17.830144 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9e661fca-6b08-4d69-acf8-fff6868c7662 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:17.830777 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9e661fca-6b08-4d69-acf8-fff6868c7662 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:17.837362 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e661fca-6b08-4d69-acf8-fff6868c7662 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:17.838607 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e661fca-6b08-4d69-acf8-fff6868c7662 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:17.839223 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e661fca-6b08-4d69-acf8-fff6868c7662 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:17.840205 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e661fca-6b08-4d69-acf8-fff6868c7662 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:17.840622 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e661fca-6b08-4d69-acf8-fff6868c7662 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:17.841044 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e661fca-6b08-4d69-acf8-fff6868c7662 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:18.052069 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9e661fca-6b08-4d69-acf8-fff6868c7662 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:18.060067 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9e661fca-6b08-4d69-acf8-fff6868c7662 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.233782 Aug 19 15:24:18.060683 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 72/149] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:17 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:24:19.081582 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9574157c-5161-4598-83ad-50bc948fdf2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:19.082351 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9574157c-5161-4598-83ad-50bc948fdf2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:19.089824 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9574157c-5161-4598-83ad-50bc948fdf2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:19.090317 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9574157c-5161-4598-83ad-50bc948fdf2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:19.090749 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9574157c-5161-4598-83ad-50bc948fdf2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:19.091472 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9574157c-5161-4598-83ad-50bc948fdf2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:19.091895 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9574157c-5161-4598-83ad-50bc948fdf2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:19.092313 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9574157c-5161-4598-83ad-50bc948fdf2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:19.250935 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9574157c-5161-4598-83ad-50bc948fdf2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:19.258827 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9574157c-5161-4598-83ad-50bc948fdf2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.181252 Aug 19 15:24:19.259411 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 78/150] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:19 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:20.284421 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cc9e2f01-8afe-40c7-9d74-bb9bd8d2cf06 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:20.285048 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cc9e2f01-8afe-40c7-9d74-bb9bd8d2cf06 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:20.295093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc9e2f01-8afe-40c7-9d74-bb9bd8d2cf06 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:20.296219 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc9e2f01-8afe-40c7-9d74-bb9bd8d2cf06 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:20.296963 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc9e2f01-8afe-40c7-9d74-bb9bd8d2cf06 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:20.298056 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc9e2f01-8afe-40c7-9d74-bb9bd8d2cf06 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:20.298760 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc9e2f01-8afe-40c7-9d74-bb9bd8d2cf06 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:20.299490 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc9e2f01-8afe-40c7-9d74-bb9bd8d2cf06 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:20.480007 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cc9e2f01-8afe-40c7-9d74-bb9bd8d2cf06 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:20.490083 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cc9e2f01-8afe-40c7-9d74-bb9bd8d2cf06 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.209681 Aug 19 15:24:20.491182 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 73/151] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:20 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:21.520432 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f3a684c8-5531-418c-9fa1-69fa68c9cbca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:21.521050 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f3a684c8-5531-418c-9fa1-69fa68c9cbca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:21.527904 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3a684c8-5531-418c-9fa1-69fa68c9cbca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:21.528405 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3a684c8-5531-418c-9fa1-69fa68c9cbca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:21.529017 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3a684c8-5531-418c-9fa1-69fa68c9cbca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:21.529718 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3a684c8-5531-418c-9fa1-69fa68c9cbca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:21.530161 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3a684c8-5531-418c-9fa1-69fa68c9cbca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:21.530578 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3a684c8-5531-418c-9fa1-69fa68c9cbca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:21.673535 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f3a684c8-5531-418c-9fa1-69fa68c9cbca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:21.682826 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f3a684c8-5531-418c-9fa1-69fa68c9cbca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.165586 Aug 19 15:24:21.683676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 79/152] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:21 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:22.254807 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-306762cf-b952-4c16-890d-70ff3d27de8e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-563967504", "imageRef": "27174b76-85e7-4123-a2bc-847959ca59f2", "flavorRef": "452", "networks": [{"uuid": "ab9ca31a-f85c-4567-b91b-7d53a8006dd9"}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:24:22.316545 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-306762cf-b952-4c16-890d-70ff3d27de8e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] validate_networks() for [('ab9ca31a-f85c-4567-b91b-7d53a8006dd9', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:24:22.704116 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c7e5041a-2462-4827-9da5-b6c0bcbdcd87 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:22.706355 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c7e5041a-2462-4827-9da5-b6c0bcbdcd87 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:22.714453 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7e5041a-2462-4827-9da5-b6c0bcbdcd87 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:22.720469 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7e5041a-2462-4827-9da5-b6c0bcbdcd87 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:22.720469 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7e5041a-2462-4827-9da5-b6c0bcbdcd87 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:22.720469 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7e5041a-2462-4827-9da5-b6c0bcbdcd87 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:22.720469 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7e5041a-2462-4827-9da5-b6c0bcbdcd87 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:22.720936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7e5041a-2462-4827-9da5-b6c0bcbdcd87 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:22.751963 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-306762cf-b952-4c16-890d-70ff3d27de8e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:24:22.753113 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-306762cf-b952-4c16-890d-70ff3d27de8e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:24:22.753745 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-306762cf-b952-4c16-890d-70ff3d27de8e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:24:22.754312 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-306762cf-b952-4c16-890d-70ff3d27de8e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:24:22.754878 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-306762cf-b952-4c16-890d-70ff3d27de8e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:24:22.768377 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-306762cf-b952-4c16-890d-70ff3d27de8e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:22.769121 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-306762cf-b952-4c16-890d-70ff3d27de8e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:22.769764 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-306762cf-b952-4c16-890d-70ff3d27de8e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:22.770718 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-306762cf-b952-4c16-890d-70ff3d27de8e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:22.771328 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-306762cf-b952-4c16-890d-70ff3d27de8e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:22.771756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-306762cf-b952-4c16-890d-70ff3d27de8e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:22.798893 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-306762cf-b952-4c16-890d-70ff3d27de8e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Getting quotas for project fc839eae8c504e298673b61d4de8b0e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:24:22.806404 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-306762cf-b952-4c16-890d-70ff3d27de8e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Getting quotas for user 887eceef50b84dde975e15ac9e7da02b and project fc839eae8c504e298673b61d4de8b0e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:24:22.822120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-306762cf-b952-4c16-890d-70ff3d27de8e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:24:22.826592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-306762cf-b952-4c16-890d-70ff3d27de8e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27174b76-85e7-4123-a2bc-847959ca59f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:24:22.908010 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-306762cf-b952-4c16-890d-70ff3d27de8e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656906 Aug 19 15:24:22.909379 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 74/153] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:24:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 15:24:22.934065 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-07875708-9299-4f03-945e-6a50d0e8773d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:22.946290 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-07875708-9299-4f03-945e-6a50d0e8773d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:23.004929 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c7e5041a-2462-4827-9da5-b6c0bcbdcd87 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:23.015316 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c7e5041a-2462-4827-9da5-b6c0bcbdcd87 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.315591 Aug 19 15:24:23.017813 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 80/154] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:22 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:23.071244 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-07875708-9299-4f03-945e-6a50d0e8773d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:23.081709 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-07875708-9299-4f03-945e-6a50d0e8773d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1213 microversion: 2.1 time: 0.164148 Aug 19 15:24:23.082978 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 75/155] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:22 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1213 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:24.040861 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a07161e9-aae2-42a9-bfbc-a569dd227da9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:24.042230 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a07161e9-aae2-42a9-bfbc-a569dd227da9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:24.050507 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a07161e9-aae2-42a9-bfbc-a569dd227da9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:24.051288 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a07161e9-aae2-42a9-bfbc-a569dd227da9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:24.051727 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a07161e9-aae2-42a9-bfbc-a569dd227da9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:24.052880 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a07161e9-aae2-42a9-bfbc-a569dd227da9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:24.053340 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a07161e9-aae2-42a9-bfbc-a569dd227da9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:24.054793 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a07161e9-aae2-42a9-bfbc-a569dd227da9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:24.112701 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9539c280-c4aa-4eee-8eab-7490c12ff177 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:24.112701 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9539c280-c4aa-4eee-8eab-7490c12ff177 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:24.123219 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9539c280-c4aa-4eee-8eab-7490c12ff177 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:24.123219 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9539c280-c4aa-4eee-8eab-7490c12ff177 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:24.123219 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9539c280-c4aa-4eee-8eab-7490c12ff177 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:24.123219 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9539c280-c4aa-4eee-8eab-7490c12ff177 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:24.123937 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9539c280-c4aa-4eee-8eab-7490c12ff177 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:24.123937 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9539c280-c4aa-4eee-8eab-7490c12ff177 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:24.209232 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9539c280-c4aa-4eee-8eab-7490c12ff177 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:24.219165 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9539c280-c4aa-4eee-8eab-7490c12ff177 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1273 microversion: 2.1 time: 0.118922 Aug 19 15:24:24.221010 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 76/156] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:24 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:24.233702 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ced49127-9e48-445f-9301-b09a5e232e47 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:24.235495 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ced49127-9e48-445f-9301-b09a5e232e47 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:24.256993 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ced49127-9e48-445f-9301-b09a5e232e47 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:24.258873 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ced49127-9e48-445f-9301-b09a5e232e47 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:24.262445 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ced49127-9e48-445f-9301-b09a5e232e47 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:24.264561 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ced49127-9e48-445f-9301-b09a5e232e47 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:24.265028 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ced49127-9e48-445f-9301-b09a5e232e47 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:24.266351 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ced49127-9e48-445f-9301-b09a5e232e47 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:24.294571 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a07161e9-aae2-42a9-bfbc-a569dd227da9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:24.312499 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a07161e9-aae2-42a9-bfbc-a569dd227da9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.277752 Aug 19 15:24:24.327881 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 81/157] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:24 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:24.336001 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ced49127-9e48-445f-9301-b09a5e232e47 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:24:24.473193 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ced49127-9e48-445f-9301-b09a5e232e47 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "DELETE /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 204 len: 0 microversion: 2.1 time: 0.248518 Aug 19 15:24:24.474002 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 77/158] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:24:24 2022] DELETE /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:24:24.485272 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3d1587dc-24a8-44f4-8a8c-e6c608cfcf20 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:24.485982 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3d1587dc-24a8-44f4-8a8c-e6c608cfcf20 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:24.492748 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d1587dc-24a8-44f4-8a8c-e6c608cfcf20 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:24.493358 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d1587dc-24a8-44f4-8a8c-e6c608cfcf20 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:24.493715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d1587dc-24a8-44f4-8a8c-e6c608cfcf20 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:24.495616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d1587dc-24a8-44f4-8a8c-e6c608cfcf20 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:24.496073 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d1587dc-24a8-44f4-8a8c-e6c608cfcf20 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:24.496515 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d1587dc-24a8-44f4-8a8c-e6c608cfcf20 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:24.761658 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3d1587dc-24a8-44f4-8a8c-e6c608cfcf20 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:24.773529 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3d1587dc-24a8-44f4-8a8c-e6c608cfcf20 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1553 microversion: 2.1 time: 0.293568 Aug 19 15:24:24.777265 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 82/159] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:24 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1553 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:24:25.248045 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a8a23bb7-c906-402f-8977-5b6c4a104867 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:25.253789 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a8a23bb7-c906-402f-8977-5b6c4a104867 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:25.273870 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8a23bb7-c906-402f-8977-5b6c4a104867 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:25.274655 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8a23bb7-c906-402f-8977-5b6c4a104867 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:25.275366 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8a23bb7-c906-402f-8977-5b6c4a104867 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:25.277139 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8a23bb7-c906-402f-8977-5b6c4a104867 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:25.278779 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8a23bb7-c906-402f-8977-5b6c4a104867 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:25.279524 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8a23bb7-c906-402f-8977-5b6c4a104867 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:25.347668 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3a60ae90-11f2-43bf-a40f-ea5b9c891a82 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:25.348951 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3a60ae90-11f2-43bf-a40f-ea5b9c891a82 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:25.357371 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a60ae90-11f2-43bf-a40f-ea5b9c891a82 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:25.357883 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a60ae90-11f2-43bf-a40f-ea5b9c891a82 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:25.358296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a60ae90-11f2-43bf-a40f-ea5b9c891a82 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:25.359178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a60ae90-11f2-43bf-a40f-ea5b9c891a82 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:25.359635 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a60ae90-11f2-43bf-a40f-ea5b9c891a82 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:25.360056 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a60ae90-11f2-43bf-a40f-ea5b9c891a82 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:25.366135 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:25.559526 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a8a23bb7-c906-402f-8977-5b6c4a104867 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:25.569783 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a8a23bb7-c906-402f-8977-5b6c4a104867 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1313 microversion: 2.1 time: 0.329647 Aug 19 15:24:25.584504 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 78/160] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:25 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:25.605459 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3a60ae90-11f2-43bf-a40f-ea5b9c891a82 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:25.616266 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3a60ae90-11f2-43bf-a40f-ea5b9c891a82 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.273015 Aug 19 15:24:25.617880 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 83/161] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:25 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:25.794975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3faceb96-84fd-4c56-94f1-59bc8d2dd5e1 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:25.795581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3faceb96-84fd-4c56-94f1-59bc8d2dd5e1 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:25.801738 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3faceb96-84fd-4c56-94f1-59bc8d2dd5e1 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:25.802468 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3faceb96-84fd-4c56-94f1-59bc8d2dd5e1 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:25.803100 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3faceb96-84fd-4c56-94f1-59bc8d2dd5e1 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:25.803838 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3faceb96-84fd-4c56-94f1-59bc8d2dd5e1 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:25.804516 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3faceb96-84fd-4c56-94f1-59bc8d2dd5e1 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:25.805063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3faceb96-84fd-4c56-94f1-59bc8d2dd5e1 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:25.968641 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3faceb96-84fd-4c56-94f1-59bc8d2dd5e1 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:25.977834 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3faceb96-84fd-4c56-94f1-59bc8d2dd5e1 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1553 microversion: 2.1 time: 0.186881 Aug 19 15:24:25.978433 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 79/162] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:25 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:26.593416 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-03ae8ffa-8fbb-4967-b1e8-e274e5b1011c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:26.595451 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-03ae8ffa-8fbb-4967-b1e8-e274e5b1011c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:26.603645 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03ae8ffa-8fbb-4967-b1e8-e274e5b1011c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:26.604724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03ae8ffa-8fbb-4967-b1e8-e274e5b1011c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:26.606419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03ae8ffa-8fbb-4967-b1e8-e274e5b1011c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:26.607159 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03ae8ffa-8fbb-4967-b1e8-e274e5b1011c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:26.607619 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03ae8ffa-8fbb-4967-b1e8-e274e5b1011c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:26.608467 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03ae8ffa-8fbb-4967-b1e8-e274e5b1011c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:26.641188 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-814b8c0e-51f5-4a71-a91c-287f8f0c283b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:26.641804 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-814b8c0e-51f5-4a71-a91c-287f8f0c283b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:26.652233 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-814b8c0e-51f5-4a71-a91c-287f8f0c283b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:26.652754 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-814b8c0e-51f5-4a71-a91c-287f8f0c283b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:26.658061 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-814b8c0e-51f5-4a71-a91c-287f8f0c283b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:26.660516 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-814b8c0e-51f5-4a71-a91c-287f8f0c283b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:26.662333 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-814b8c0e-51f5-4a71-a91c-287f8f0c283b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:26.663635 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-814b8c0e-51f5-4a71-a91c-287f8f0c283b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:26.948463 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-814b8c0e-51f5-4a71-a91c-287f8f0c283b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:26.951964 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-03ae8ffa-8fbb-4967-b1e8-e274e5b1011c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:26.965388 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-814b8c0e-51f5-4a71-a91c-287f8f0c283b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.328856 Aug 19 15:24:26.965986 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 80/163] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:26 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:26.970964 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-03ae8ffa-8fbb-4967-b1e8-e274e5b1011c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1313 microversion: 2.1 time: 0.383581 Aug 19 15:24:26.986250 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 84/164] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:26 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:27.000225 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4cc5fdd1-9778-4c01-8851-b1b43108b294 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:27.000876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4cc5fdd1-9778-4c01-8851-b1b43108b294 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:27.007575 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4cc5fdd1-9778-4c01-8851-b1b43108b294 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:27.008517 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4cc5fdd1-9778-4c01-8851-b1b43108b294 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:27.009127 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4cc5fdd1-9778-4c01-8851-b1b43108b294 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:27.010780 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4cc5fdd1-9778-4c01-8851-b1b43108b294 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:27.011652 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4cc5fdd1-9778-4c01-8851-b1b43108b294 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:27.012542 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4cc5fdd1-9778-4c01-8851-b1b43108b294 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:27.197113 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-3070d6c8-c0a8-4970-b098-bbfb7896b630 req-3b9a5801-6f97-4c1a-9275-b2fdccb4b8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3441cda4-095a-48d3-9e4d-15c5dc40f334", "tag": "937ee5da-2200-4ee3-9d5a-4b7d31cd9700"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:24:27.213983 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-3070d6c8-c0a8-4970-b098-bbfb7896b630 req-3b9a5801-6f97-4c1a-9275-b2fdccb4b8b3 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:27.214461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-3070d6c8-c0a8-4970-b098-bbfb7896b630 req-3b9a5801-6f97-4c1a-9275-b2fdccb4b8b3 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:27.214939 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-3070d6c8-c0a8-4970-b098-bbfb7896b630 req-3b9a5801-6f97-4c1a-9275-b2fdccb4b8b3 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:27.227812 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-3070d6c8-c0a8-4970-b098-bbfb7896b630 req-3b9a5801-6f97-4c1a-9275-b2fdccb4b8b3 service nova] Creating event network-changed:937ee5da-2200-4ee3-9d5a-4b7d31cd9700 for instance 3441cda4-095a-48d3-9e4d-15c5dc40f334 on hv-cinder-83538 Aug 19 15:24:27.237948 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-3070d6c8-c0a8-4970-b098-bbfb7896b630 req-3b9a5801-6f97-4c1a-9275-b2fdccb4b8b3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044291 Aug 19 15:24:27.238751 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 81/165] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:24:27.240015 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4cc5fdd1-9778-4c01-8851-b1b43108b294 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:27.250205 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4cc5fdd1-9778-4c01-8851-b1b43108b294 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1553 microversion: 2.1 time: 0.253595 Aug 19 15:24:27.250784 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 85/166] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:26 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1553 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:27.989662 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6830064d-4a73-4595-a41e-704225ba8b99 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:27.989662 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6830064d-4a73-4595-a41e-704225ba8b99 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:27.995368 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7676af66-b79c-4e3e-956e-1bdde8ed1978 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:27.996277 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7676af66-b79c-4e3e-956e-1bdde8ed1978 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:27.996669 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6830064d-4a73-4595-a41e-704225ba8b99 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:27.997249 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6830064d-4a73-4595-a41e-704225ba8b99 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:27.997597 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6830064d-4a73-4595-a41e-704225ba8b99 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:27.998288 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6830064d-4a73-4595-a41e-704225ba8b99 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:27.998706 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6830064d-4a73-4595-a41e-704225ba8b99 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:27.999289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6830064d-4a73-4595-a41e-704225ba8b99 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:28.005432 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7676af66-b79c-4e3e-956e-1bdde8ed1978 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:28.006001 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7676af66-b79c-4e3e-956e-1bdde8ed1978 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:28.006546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7676af66-b79c-4e3e-956e-1bdde8ed1978 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:28.007329 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7676af66-b79c-4e3e-956e-1bdde8ed1978 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:28.007948 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7676af66-b79c-4e3e-956e-1bdde8ed1978 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:28.008489 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7676af66-b79c-4e3e-956e-1bdde8ed1978 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:28.229396 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6830064d-4a73-4595-a41e-704225ba8b99 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:28.235788 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7676af66-b79c-4e3e-956e-1bdde8ed1978 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:28.239338 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6830064d-4a73-4595-a41e-704225ba8b99 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.255421 Aug 19 15:24:28.240416 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 82/167] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:27 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:28.254214 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7676af66-b79c-4e3e-956e-1bdde8ed1978 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1313 microversion: 2.1 time: 0.262241 Aug 19 15:24:28.255258 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 86/168] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:27 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:28.270953 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f5ff395d-4e10-4bfa-9f63-9b9316fef491 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:28.271563 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f5ff395d-4e10-4bfa-9f63-9b9316fef491 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:28.278551 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ff395d-4e10-4bfa-9f63-9b9316fef491 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:28.279307 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ff395d-4e10-4bfa-9f63-9b9316fef491 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:28.279921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ff395d-4e10-4bfa-9f63-9b9316fef491 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:28.280638 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ff395d-4e10-4bfa-9f63-9b9316fef491 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:28.281088 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ff395d-4e10-4bfa-9f63-9b9316fef491 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:28.281493 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ff395d-4e10-4bfa-9f63-9b9316fef491 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:28.359313 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f5ff395d-4e10-4bfa-9f63-9b9316fef491 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:28.370105 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f5ff395d-4e10-4bfa-9f63-9b9316fef491 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1346 microversion: 2.1 time: 0.102143 Aug 19 15:24:28.370897 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 83/169] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:28 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:29.256754 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-543791a2-7fdd-4a74-a060-b5ababf531c4 req-7463d546-1cc0-4ae6-88d2-43eea165dec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "903776c1-6779-4794-81e4-257cbfdb5908", "name": "network-vif-deleted", "tag": "44c3f537-79e8-434b-8284-5ff8ab0dcb5c"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:24:29.262290 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-91f13315-e71c-44db-9162-64b1bce9a480 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:29.262904 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-91f13315-e71c-44db-9162-64b1bce9a480 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:29.268263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-543791a2-7fdd-4a74-a060-b5ababf531c4 req-7463d546-1cc0-4ae6-88d2-43eea165dec4 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:29.268786 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91f13315-e71c-44db-9162-64b1bce9a480 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:29.268898 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-543791a2-7fdd-4a74-a060-b5ababf531c4 req-7463d546-1cc0-4ae6-88d2-43eea165dec4 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:29.269263 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91f13315-e71c-44db-9162-64b1bce9a480 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:29.269410 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-543791a2-7fdd-4a74-a060-b5ababf531c4 req-7463d546-1cc0-4ae6-88d2-43eea165dec4 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:29.270148 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91f13315-e71c-44db-9162-64b1bce9a480 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:29.270989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91f13315-e71c-44db-9162-64b1bce9a480 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:29.271722 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91f13315-e71c-44db-9162-64b1bce9a480 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:29.272293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91f13315-e71c-44db-9162-64b1bce9a480 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:29.282864 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-543791a2-7fdd-4a74-a060-b5ababf531c4 req-7463d546-1cc0-4ae6-88d2-43eea165dec4 service nova] Creating event network-vif-deleted:44c3f537-79e8-434b-8284-5ff8ab0dcb5c for instance 903776c1-6779-4794-81e4-257cbfdb5908 on hv-cinder-83538 Aug 19 15:24:29.287993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-543791a2-7fdd-4a74-a060-b5ababf531c4 req-7463d546-1cc0-4ae6-88d2-43eea165dec4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035550 Aug 19 15:24:29.288635 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 87/170] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:24:29.296836 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fd1ed504-05a6-4b89-b65c-27130ef96a3e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:29.297531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fd1ed504-05a6-4b89-b65c-27130ef96a3e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:29.304457 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd1ed504-05a6-4b89-b65c-27130ef96a3e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:29.305176 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd1ed504-05a6-4b89-b65c-27130ef96a3e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:29.305868 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd1ed504-05a6-4b89-b65c-27130ef96a3e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:29.306846 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd1ed504-05a6-4b89-b65c-27130ef96a3e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:29.307354 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd1ed504-05a6-4b89-b65c-27130ef96a3e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:29.307900 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd1ed504-05a6-4b89-b65c-27130ef96a3e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:29.502799 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-91f13315-e71c-44db-9162-64b1bce9a480 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:29.505713 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fd1ed504-05a6-4b89-b65c-27130ef96a3e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:29.507448 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:29.513887 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fd1ed504-05a6-4b89-b65c-27130ef96a3e tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1313 microversion: 2.1 time: 0.221059 Aug 19 15:24:29.527358 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-91f13315-e71c-44db-9162-64b1bce9a480 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.257636 Aug 19 15:24:29.527577 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 88/171] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:29 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:29.527577 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-971a528f-a2bf-4726-82cc-062cfa959414 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:29.527577 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-971a528f-a2bf-4726-82cc-062cfa959414 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:29.527577 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-971a528f-a2bf-4726-82cc-062cfa959414 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:29.527577 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-971a528f-a2bf-4726-82cc-062cfa959414 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:29.527905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-971a528f-a2bf-4726-82cc-062cfa959414 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:29.528109 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-971a528f-a2bf-4726-82cc-062cfa959414 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:29.528599 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 84/172] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:29 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:24:29.528753 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-971a528f-a2bf-4726-82cc-062cfa959414 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:29.529316 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-971a528f-a2bf-4726-82cc-062cfa959414 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:29.798993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-971a528f-a2bf-4726-82cc-062cfa959414 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:29.807360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-971a528f-a2bf-4726-82cc-062cfa959414 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1346 microversion: 2.1 time: 0.291618 Aug 19 15:24:29.807935 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 89/173] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:29 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1346 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:30.534510 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4c75983e-d61a-47db-8cd0-dddb776b2779 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:30.535042 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5dd28d5d-d78e-4477-a435-65e9e341ac21 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:30.535433 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5dd28d5d-d78e-4477-a435-65e9e341ac21 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:30.535522 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4c75983e-d61a-47db-8cd0-dddb776b2779 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:30.542191 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dd28d5d-d78e-4477-a435-65e9e341ac21 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:30.542679 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dd28d5d-d78e-4477-a435-65e9e341ac21 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:30.543326 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dd28d5d-d78e-4477-a435-65e9e341ac21 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:30.544028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dd28d5d-d78e-4477-a435-65e9e341ac21 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:30.544664 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dd28d5d-d78e-4477-a435-65e9e341ac21 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:30.544784 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c75983e-d61a-47db-8cd0-dddb776b2779 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:30.545287 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c75983e-d61a-47db-8cd0-dddb776b2779 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:30.545508 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dd28d5d-d78e-4477-a435-65e9e341ac21 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:30.545708 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c75983e-d61a-47db-8cd0-dddb776b2779 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:30.546401 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c75983e-d61a-47db-8cd0-dddb776b2779 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:30.546853 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c75983e-d61a-47db-8cd0-dddb776b2779 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:30.547274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c75983e-d61a-47db-8cd0-dddb776b2779 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:30.746471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5dd28d5d-d78e-4477-a435-65e9e341ac21 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:30.749534 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4c75983e-d61a-47db-8cd0-dddb776b2779 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:30.754761 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5dd28d5d-d78e-4477-a435-65e9e341ac21 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.223742 Aug 19 15:24:30.755855 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 90/174] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:30 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:24:30.758526 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4c75983e-d61a-47db-8cd0-dddb776b2779 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1313 microversion: 2.1 time: 0.227890 Aug 19 15:24:30.759161 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 85/175] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:30 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:30.829839 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-394ed6e8-0be5-4169-8f4d-baea19c45915 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:30.830435 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-394ed6e8-0be5-4169-8f4d-baea19c45915 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:30.836226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-394ed6e8-0be5-4169-8f4d-baea19c45915 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:30.836732 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-394ed6e8-0be5-4169-8f4d-baea19c45915 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:30.837156 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-394ed6e8-0be5-4169-8f4d-baea19c45915 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:30.837932 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-394ed6e8-0be5-4169-8f4d-baea19c45915 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:30.839171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-394ed6e8-0be5-4169-8f4d-baea19c45915 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:30.839730 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-394ed6e8-0be5-4169-8f4d-baea19c45915 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:30.903947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-394ed6e8-0be5-4169-8f4d-baea19c45915 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:30.918384 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-394ed6e8-0be5-4169-8f4d-baea19c45915 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1346 microversion: 2.1 time: 0.091960 Aug 19 15:24:30.919607 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 91/176] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:30 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:31.775375 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7e60a0c1-ecdf-4ee9-9cd7-4faa2762d8f8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:31.776167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7e60a0c1-ecdf-4ee9-9cd7-4faa2762d8f8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:31.781122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-34b2e022-beb8-4002-8fab-d326bd8d958b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:31.782239 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-34b2e022-beb8-4002-8fab-d326bd8d958b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:31.782580 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e60a0c1-ecdf-4ee9-9cd7-4faa2762d8f8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:31.783064 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e60a0c1-ecdf-4ee9-9cd7-4faa2762d8f8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:31.783493 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e60a0c1-ecdf-4ee9-9cd7-4faa2762d8f8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:31.784437 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e60a0c1-ecdf-4ee9-9cd7-4faa2762d8f8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:31.784890 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e60a0c1-ecdf-4ee9-9cd7-4faa2762d8f8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:31.785307 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e60a0c1-ecdf-4ee9-9cd7-4faa2762d8f8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:31.789245 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34b2e022-beb8-4002-8fab-d326bd8d958b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:31.789929 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34b2e022-beb8-4002-8fab-d326bd8d958b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:31.790364 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34b2e022-beb8-4002-8fab-d326bd8d958b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:31.792017 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34b2e022-beb8-4002-8fab-d326bd8d958b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:31.792771 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34b2e022-beb8-4002-8fab-d326bd8d958b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:31.793255 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34b2e022-beb8-4002-8fab-d326bd8d958b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:31.992376 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7e60a0c1-ecdf-4ee9-9cd7-4faa2762d8f8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:32.000729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-34b2e022-beb8-4002-8fab-d326bd8d958b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:32.001228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7e60a0c1-ecdf-4ee9-9cd7-4faa2762d8f8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.229976 Aug 19 15:24:32.001808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 86/177] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:31 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:32.012882 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-34b2e022-beb8-4002-8fab-d326bd8d958b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1313 microversion: 2.1 time: 0.235465 Aug 19 15:24:32.013806 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 92/178] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:31 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:24:32.017056 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c26b6384-75d0-4e76-8825-d6c5cf83a158 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:32.017730 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c26b6384-75d0-4e76-8825-d6c5cf83a158 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:32.023871 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c26b6384-75d0-4e76-8825-d6c5cf83a158 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:32.027011 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c26b6384-75d0-4e76-8825-d6c5cf83a158 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:32.027499 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c26b6384-75d0-4e76-8825-d6c5cf83a158 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:32.028219 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c26b6384-75d0-4e76-8825-d6c5cf83a158 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:32.028719 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c26b6384-75d0-4e76-8825-d6c5cf83a158 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:32.029145 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c26b6384-75d0-4e76-8825-d6c5cf83a158 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:32.062986 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c26b6384-75d0-4e76-8825-d6c5cf83a158 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:32.063463 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c26b6384-75d0-4e76-8825-d6c5cf83a158 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:32.063888 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c26b6384-75d0-4e76-8825-d6c5cf83a158 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:32.064339 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-c26b6384-75d0-4e76-8825-d6c5cf83a158 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lazy-loading 'fault' on Instance uuid 903776c1-6779-4794-81e4-257cbfdb5908 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:24:32.114011 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c26b6384-75d0-4e76-8825-d6c5cf83a158 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fa0eb8e5ad41038d447c54bad91a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea214b3e591a44928fd7af5f51095405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:32.123006 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c26b6384-75d0-4e76-8825-d6c5cf83a158 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 200 len: 1351 microversion: 2.1 time: 0.120172 Aug 19 15:24:32.123861 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 87/179] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:32 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:33.022886 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-455f46a5-36f3-47f1-bfc4-9fee3f15acfb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:33.023471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-455f46a5-36f3-47f1-bfc4-9fee3f15acfb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:33.029616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-455f46a5-36f3-47f1-bfc4-9fee3f15acfb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:33.030113 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-455f46a5-36f3-47f1-bfc4-9fee3f15acfb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:33.030538 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-455f46a5-36f3-47f1-bfc4-9fee3f15acfb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:33.031218 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-455f46a5-36f3-47f1-bfc4-9fee3f15acfb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:33.031655 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-455f46a5-36f3-47f1-bfc4-9fee3f15acfb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:33.032067 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-455f46a5-36f3-47f1-bfc4-9fee3f15acfb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:33.034363 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b5d2a7d3-450b-4160-9733-324d3a128c99 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:33.035265 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b5d2a7d3-450b-4160-9733-324d3a128c99 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:33.037656 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:33.044365 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5d2a7d3-450b-4160-9733-324d3a128c99 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:33.044885 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5d2a7d3-450b-4160-9733-324d3a128c99 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:33.045324 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5d2a7d3-450b-4160-9733-324d3a128c99 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:33.046018 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5d2a7d3-450b-4160-9733-324d3a128c99 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:33.046468 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5d2a7d3-450b-4160-9733-324d3a128c99 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:33.046889 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5d2a7d3-450b-4160-9733-324d3a128c99 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:33.076767 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=8 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:33.232535 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-455f46a5-36f3-47f1-bfc4-9fee3f15acfb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:33.239722 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b5d2a7d3-450b-4160-9733-324d3a128c99 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:33.240331 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-455f46a5-36f3-47f1-bfc4-9fee3f15acfb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.221375 Aug 19 15:24:33.240937 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 93/180] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:33 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:33.245910 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bdc438ff-d1d4-4f26-9138-55652308e7e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:33.246501 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bdc438ff-d1d4-4f26-9138-55652308e7e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:33.250089 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b5d2a7d3-450b-4160-9733-324d3a128c99 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1313 microversion: 2.1 time: 0.219506 Aug 19 15:24:33.250766 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 88/181] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:33 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:24:33.252635 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdc438ff-d1d4-4f26-9138-55652308e7e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:33.253216 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdc438ff-d1d4-4f26-9138-55652308e7e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:33.253772 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdc438ff-d1d4-4f26-9138-55652308e7e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:33.254552 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdc438ff-d1d4-4f26-9138-55652308e7e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:33.255092 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdc438ff-d1d4-4f26-9138-55652308e7e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:33.255511 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdc438ff-d1d4-4f26-9138-55652308e7e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:33.269464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-bdc438ff-d1d4-4f26-9138-55652308e7e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] HTTP exception thrown: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bdc438ff-d1d4-4f26-9138-55652308e7e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Request method failure captured: Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 HTTP/1.1 Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6rjO_q_SILVpCNjLiACK4dLaczI5WQ0yj6Bmzq3HpYnibobHy5NkCS2XJMhIpT3o_enGvPijm7DDjxTXLW2kMskScvdHniTy8F8_r3QmUch0O7pZ-4uCSLCTl826MIJ0WkEsn1fvWDiXHeAdRbIk574mryl4Q-LUma7TYBcWT4Rb7g Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: ea214b3e591a44928fd7af5f51095405 Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-DeleteServersTestJSON-496873357 Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:24:33.274133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:24:33.275662 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_ea214b3e591a44928fd7af5f51095405", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ea214b3e591a44928fd7af5f51095405"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ea214b3e591a44928fd7af5f51095405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/ea214b3e591a44928fd7af5f51095405"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:24:33.275662 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-DeleteServersTestJSON-496873357 Aug 19 15:24:33.275662 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: ea214b3e591a44928fd7af5f51095405 Aug 19 15:24:33.275662 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-DeleteServersTestJSON-496873357 Aug 19 15:24:33.275662 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-DeleteServersTestJSON-496873357-project Aug 19 15:24:33.275662 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:24:33.275662 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:24:33.275662 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 58fa0eb8e5ad41038d447c54bad91a6d Aug 19 15:24:33.275662 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-DeleteServersTestJSON-496873357-project Aug 19 15:24:33.275662 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:24:33.275662 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:33.275662 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': '903776c1-6779-4794-81e4-257cbfdb5908'} Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:24:33.276724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:24:33.278060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:24:33.278060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:24:33.278060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:24:33.278060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:24:33.278060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:24:33.278060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:24:33.278060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:24:33.278060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:33.278060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:33.278060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:33.278060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:33.278060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:33.278060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:24:33.278060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:24:33.278060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:24:33.278060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:24:33.278060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:33.278060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:33.279278 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bdc438ff-d1d4-4f26-9138-55652308e7e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Returning 404 to user: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:24:33.279278 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bdc438ff-d1d4-4f26-9138-55652308e7e8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 404 len: 111 microversion: 2.1 time: 0.033641 Aug 19 15:24:33.279278 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 94/182] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:33 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:24:33.388455 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9e93ad72-6974-465b-b56f-18cb86ca98c8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:33.390709 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9e93ad72-6974-465b-b56f-18cb86ca98c8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:33.396709 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e93ad72-6974-465b-b56f-18cb86ca98c8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:33.397193 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e93ad72-6974-465b-b56f-18cb86ca98c8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:33.397628 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e93ad72-6974-465b-b56f-18cb86ca98c8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:33.398313 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e93ad72-6974-465b-b56f-18cb86ca98c8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:33.398754 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e93ad72-6974-465b-b56f-18cb86ca98c8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:33.399174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e93ad72-6974-465b-b56f-18cb86ca98c8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:33.414267 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-9e93ad72-6974-465b-b56f-18cb86ca98c8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] HTTP exception thrown: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9e93ad72-6974-465b-b56f-18cb86ca98c8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Request method failure captured: Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908/os-volume_attachments HTTP/1.1 Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6rjO_q_SILVpCNjLiACK4dLaczI5WQ0yj6Bmzq3HpYnibobHy5NkCS2XJMhIpT3o_enGvPijm7DDjxTXLW2kMskScvdHniTy8F8_r3QmUch0O7pZ-4uCSLCTl826MIJ0WkEsn1fvWDiXHeAdRbIk574mryl4Q-LUma7TYBcWT4Rb7g Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: ea214b3e591a44928fd7af5f51095405 Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-DeleteServersTestJSON-496873357 Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:24:33.419293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:24:33.420756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_ea214b3e591a44928fd7af5f51095405", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ea214b3e591a44928fd7af5f51095405"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ea214b3e591a44928fd7af5f51095405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/ea214b3e591a44928fd7af5f51095405"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:24:33.420756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-DeleteServersTestJSON-496873357 Aug 19 15:24:33.420756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: ea214b3e591a44928fd7af5f51095405 Aug 19 15:24:33.420756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-DeleteServersTestJSON-496873357 Aug 19 15:24:33.420756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-DeleteServersTestJSON-496873357-project Aug 19 15:24:33.420756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:24:33.420756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:24:33.420756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: 58fa0eb8e5ad41038d447c54bad91a6d Aug 19 15:24:33.420756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-DeleteServersTestJSON-496873357-project Aug 19 15:24:33.420756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:24:33.420756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:33.420756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'server_id': '903776c1-6779-4794-81e4-257cbfdb5908'} Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:24:33.421533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:33.422617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:33.423988 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9e93ad72-6974-465b-b56f-18cb86ca98c8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Returning 404 to user: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:24:33.423988 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9e93ad72-6974-465b-b56f-18cb86ca98c8 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036530 Aug 19 15:24:33.423988 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 89/183] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:24:33 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:24:33.884446 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-85ae6a94-7ff7-4d6b-932a-ad61f74ae810 req-912d84d8-4a6f-428a-b427-0e5634852c5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3441cda4-095a-48d3-9e4d-15c5dc40f334", "name": "network-vif-plugged", "status": "completed", "tag": "937ee5da-2200-4ee3-9d5a-4b7d31cd9700"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:24:33.894529 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-85ae6a94-7ff7-4d6b-932a-ad61f74ae810 req-912d84d8-4a6f-428a-b427-0e5634852c5b service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:33.895006 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-85ae6a94-7ff7-4d6b-932a-ad61f74ae810 req-912d84d8-4a6f-428a-b427-0e5634852c5b service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:33.895492 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-85ae6a94-7ff7-4d6b-932a-ad61f74ae810 req-912d84d8-4a6f-428a-b427-0e5634852c5b service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:33.908256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-85ae6a94-7ff7-4d6b-932a-ad61f74ae810 req-912d84d8-4a6f-428a-b427-0e5634852c5b service nova] Creating event network-vif-plugged:937ee5da-2200-4ee3-9d5a-4b7d31cd9700 for instance 3441cda4-095a-48d3-9e4d-15c5dc40f334 on hv-cinder-83538 Aug 19 15:24:33.913880 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-85ae6a94-7ff7-4d6b-932a-ad61f74ae810 req-912d84d8-4a6f-428a-b427-0e5634852c5b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033136 Aug 19 15:24:33.914465 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 95/184] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:24:34.262582 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a798da2d-383d-4713-a539-9ae1220618d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:34.263195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a798da2d-383d-4713-a539-9ae1220618d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:34.269541 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a798da2d-383d-4713-a539-9ae1220618d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:34.270027 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a798da2d-383d-4713-a539-9ae1220618d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:34.270462 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a798da2d-383d-4713-a539-9ae1220618d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:34.271146 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a798da2d-383d-4713-a539-9ae1220618d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:34.271528 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b95c8f12-31dd-4e1a-85af-0a46a107274f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:34.271951 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a798da2d-383d-4713-a539-9ae1220618d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:34.272046 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a798da2d-383d-4713-a539-9ae1220618d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:34.272212 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b95c8f12-31dd-4e1a-85af-0a46a107274f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:34.279519 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b95c8f12-31dd-4e1a-85af-0a46a107274f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:34.279993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b95c8f12-31dd-4e1a-85af-0a46a107274f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:34.280438 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b95c8f12-31dd-4e1a-85af-0a46a107274f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:34.281121 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b95c8f12-31dd-4e1a-85af-0a46a107274f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:34.281562 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b95c8f12-31dd-4e1a-85af-0a46a107274f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:34.281976 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b95c8f12-31dd-4e1a-85af-0a46a107274f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:34.466721 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a798da2d-383d-4713-a539-9ae1220618d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:34.473910 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b95c8f12-31dd-4e1a-85af-0a46a107274f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:34.474749 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a798da2d-383d-4713-a539-9ae1220618d1 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.216081 Aug 19 15:24:34.475324 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 90/185] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:34 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:34.484597 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b95c8f12-31dd-4e1a-85af-0a46a107274f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1313 microversion: 2.1 time: 0.216995 Aug 19 15:24:34.485521 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 96/186] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:34 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:35.495639 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c95de5cf-3c74-49cb-9a80-4b88048c2209 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:35.496237 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c95de5cf-3c74-49cb-9a80-4b88048c2209 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:35.503073 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c95de5cf-3c74-49cb-9a80-4b88048c2209 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:35.503603 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c95de5cf-3c74-49cb-9a80-4b88048c2209 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:35.504039 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c95de5cf-3c74-49cb-9a80-4b88048c2209 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:35.504908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c95de5cf-3c74-49cb-9a80-4b88048c2209 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:35.505356 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c95de5cf-3c74-49cb-9a80-4b88048c2209 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:35.505779 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c95de5cf-3c74-49cb-9a80-4b88048c2209 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:35.506737 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-95e2aae9-79f0-4d1b-806d-fed9da677457 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:35.507525 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-95e2aae9-79f0-4d1b-806d-fed9da677457 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:35.515803 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95e2aae9-79f0-4d1b-806d-fed9da677457 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:35.516311 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95e2aae9-79f0-4d1b-806d-fed9da677457 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:35.516828 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95e2aae9-79f0-4d1b-806d-fed9da677457 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:35.517640 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95e2aae9-79f0-4d1b-806d-fed9da677457 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:35.518070 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95e2aae9-79f0-4d1b-806d-fed9da677457 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:35.518571 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95e2aae9-79f0-4d1b-806d-fed9da677457 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:35.725121 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c95de5cf-3c74-49cb-9a80-4b88048c2209 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:35.735958 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c95de5cf-3c74-49cb-9a80-4b88048c2209 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.244056 Aug 19 15:24:35.737099 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 91/187] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:35 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:35.757376 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-95e2aae9-79f0-4d1b-806d-fed9da677457 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:35.767143 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-95e2aae9-79f0-4d1b-806d-fed9da677457 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1313 microversion: 2.1 time: 0.264706 Aug 19 15:24:35.767946 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 97/188] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:35 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:36.758177 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-24a3917a-ffac-4f6c-95f3-f89af98fdfdb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:36.759123 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-24a3917a-ffac-4f6c-95f3-f89af98fdfdb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:36.766736 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24a3917a-ffac-4f6c-95f3-f89af98fdfdb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:36.767227 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24a3917a-ffac-4f6c-95f3-f89af98fdfdb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:36.767660 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24a3917a-ffac-4f6c-95f3-f89af98fdfdb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:36.768349 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24a3917a-ffac-4f6c-95f3-f89af98fdfdb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:36.768912 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24a3917a-ffac-4f6c-95f3-f89af98fdfdb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:36.769229 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24a3917a-ffac-4f6c-95f3-f89af98fdfdb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:36.789232 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8c01dcc6-6e35-4922-8940-602f8a36870b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:36.789936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8c01dcc6-6e35-4922-8940-602f8a36870b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:36.798200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c01dcc6-6e35-4922-8940-602f8a36870b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:36.798797 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c01dcc6-6e35-4922-8940-602f8a36870b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:36.800145 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c01dcc6-6e35-4922-8940-602f8a36870b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:36.801066 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c01dcc6-6e35-4922-8940-602f8a36870b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:36.801996 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c01dcc6-6e35-4922-8940-602f8a36870b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:36.802484 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c01dcc6-6e35-4922-8940-602f8a36870b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:36.993361 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-24a3917a-ffac-4f6c-95f3-f89af98fdfdb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:36.997526 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8c01dcc6-6e35-4922-8940-602f8a36870b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:37.002271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-24a3917a-ffac-4f6c-95f3-f89af98fdfdb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.248113 Aug 19 15:24:37.003216 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 92/189] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:36 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:24:37.007041 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8c01dcc6-6e35-4922-8940-602f8a36870b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1313 microversion: 2.1 time: 0.222642 Aug 19 15:24:37.007620 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 98/190] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:36 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:24:38.028332 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d6f2ce0d-b6d8-43af-955a-6f771508bd43 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:38.028988 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d6f2ce0d-b6d8-43af-955a-6f771508bd43 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:38.032920 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-34c53bfd-d45f-4db5-92bc-5f6de151b86e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:38.033532 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-34c53bfd-d45f-4db5-92bc-5f6de151b86e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:38.035466 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=54 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:38.035597 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6f2ce0d-b6d8-43af-955a-6f771508bd43 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:38.036006 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6f2ce0d-b6d8-43af-955a-6f771508bd43 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:38.036567 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6f2ce0d-b6d8-43af-955a-6f771508bd43 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:38.037413 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6f2ce0d-b6d8-43af-955a-6f771508bd43 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:38.037930 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6f2ce0d-b6d8-43af-955a-6f771508bd43 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:38.038358 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6f2ce0d-b6d8-43af-955a-6f771508bd43 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:38.040940 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34c53bfd-d45f-4db5-92bc-5f6de151b86e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:38.041928 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34c53bfd-d45f-4db5-92bc-5f6de151b86e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:38.042499 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34c53bfd-d45f-4db5-92bc-5f6de151b86e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:38.043195 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34c53bfd-d45f-4db5-92bc-5f6de151b86e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:38.043644 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34c53bfd-d45f-4db5-92bc-5f6de151b86e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:38.044060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34c53bfd-d45f-4db5-92bc-5f6de151b86e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:38.230716 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-34c53bfd-d45f-4db5-92bc-5f6de151b86e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:38.238505 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-34c53bfd-d45f-4db5-92bc-5f6de151b86e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.209942 Aug 19 15:24:38.239080 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 99/191] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:38 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:24:38.241842 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d6f2ce0d-b6d8-43af-955a-6f771508bd43 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:38.250537 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d6f2ce0d-b6d8-43af-955a-6f771508bd43 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1313 microversion: 2.1 time: 0.227198 Aug 19 15:24:38.251097 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 93/192] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:38 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:39.259395 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c8164d9b-570f-46b0-abd1-11107447711d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:39.259966 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c8164d9b-570f-46b0-abd1-11107447711d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:39.268165 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8164d9b-570f-46b0-abd1-11107447711d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:39.268723 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8164d9b-570f-46b0-abd1-11107447711d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:39.269298 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8164d9b-570f-46b0-abd1-11107447711d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:39.270018 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8164d9b-570f-46b0-abd1-11107447711d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:39.270472 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8164d9b-570f-46b0-abd1-11107447711d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:39.270898 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8164d9b-570f-46b0-abd1-11107447711d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:39.272819 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0f6b2f04-9ebf-47c0-bce7-382791402d6a tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:39.273670 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0f6b2f04-9ebf-47c0-bce7-382791402d6a tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:39.290009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f6b2f04-9ebf-47c0-bce7-382791402d6a tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:39.290009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f6b2f04-9ebf-47c0-bce7-382791402d6a tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:39.290009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f6b2f04-9ebf-47c0-bce7-382791402d6a tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:39.290009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f6b2f04-9ebf-47c0-bce7-382791402d6a tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:39.290328 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f6b2f04-9ebf-47c0-bce7-382791402d6a tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:39.290328 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f6b2f04-9ebf-47c0-bce7-382791402d6a tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:39.478482 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0f6b2f04-9ebf-47c0-bce7-382791402d6a tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:39.482749 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c8164d9b-570f-46b0-abd1-11107447711d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:39.487984 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0f6b2f04-9ebf-47c0-bce7-382791402d6a tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1313 microversion: 2.1 time: 0.220012 Aug 19 15:24:39.488642 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 94/193] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:39 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:39.491039 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c8164d9b-570f-46b0-abd1-11107447711d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.235703 Aug 19 15:24:39.491685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 100/194] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:39 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:39.928074 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c6ad951f-5790-447b-acdd-05aae638bd42 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:39.928603 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c6ad951f-5790-447b-acdd-05aae638bd42 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:39.935778 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6ad951f-5790-447b-acdd-05aae638bd42 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:39.936271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6ad951f-5790-447b-acdd-05aae638bd42 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:39.936879 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6ad951f-5790-447b-acdd-05aae638bd42 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:39.937784 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6ad951f-5790-447b-acdd-05aae638bd42 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:39.938280 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6ad951f-5790-447b-acdd-05aae638bd42 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:39.938746 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6ad951f-5790-447b-acdd-05aae638bd42 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:39.954050 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-c6ad951f-5790-447b-acdd-05aae638bd42 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] HTTP exception thrown: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c6ad951f-5790-447b-acdd-05aae638bd42 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Request method failure captured: Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 HTTP/1.1 Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6rjO_q_SILVpCNjLiACK4dLaczI5WQ0yj6Bmzq3HpYnibobHy5NkCS2XJMhIpT3o_enGvPijm7DDjxTXLW2kMskScvdHniTy8F8_r3QmUch0O7pZ-4uCSLCTl826MIJ0WkEsn1fvWDiXHeAdRbIk574mryl4Q-LUma7TYBcWT4Rb7g Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: ea214b3e591a44928fd7af5f51095405 Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-DeleteServersTestJSON-496873357 Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:24:39.956201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:24:39.957448 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_ea214b3e591a44928fd7af5f51095405", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ea214b3e591a44928fd7af5f51095405"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ea214b3e591a44928fd7af5f51095405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/ea214b3e591a44928fd7af5f51095405"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:24:39.957448 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-DeleteServersTestJSON-496873357 Aug 19 15:24:39.957448 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: ea214b3e591a44928fd7af5f51095405 Aug 19 15:24:39.957448 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-DeleteServersTestJSON-496873357 Aug 19 15:24:39.957448 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-DeleteServersTestJSON-496873357-project Aug 19 15:24:39.957448 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:24:39.957448 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:24:39.957448 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: 58fa0eb8e5ad41038d447c54bad91a6d Aug 19 15:24:39.957448 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-DeleteServersTestJSON-496873357-project Aug 19 15:24:39.957448 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:24:39.957448 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:39.957448 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': '903776c1-6779-4794-81e4-257cbfdb5908'} Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:24:39.958167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:39.959283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:39.960417 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c6ad951f-5790-447b-acdd-05aae638bd42 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Returning 404 to user: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:24:39.960417 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c6ad951f-5790-447b-acdd-05aae638bd42 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "DELETE /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 404 len: 111 microversion: 2.1 time: 0.034621 Aug 19 15:24:39.960417 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 95/195] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:24:39 2022] DELETE /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 15:24:39.968787 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-509c30d4-48bb-444d-8910-30cb183c08c6 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:39.969482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-509c30d4-48bb-444d-8910-30cb183c08c6 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] [instance: 903776c1-6779-4794-81e4-257cbfdb5908] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:39.977829 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-509c30d4-48bb-444d-8910-30cb183c08c6 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:39.978347 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-509c30d4-48bb-444d-8910-30cb183c08c6 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:39.978776 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-509c30d4-48bb-444d-8910-30cb183c08c6 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:39.980512 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-509c30d4-48bb-444d-8910-30cb183c08c6 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:39.981005 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-509c30d4-48bb-444d-8910-30cb183c08c6 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:39.981584 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-509c30d4-48bb-444d-8910-30cb183c08c6 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:39.996570 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-509c30d4-48bb-444d-8910-30cb183c08c6 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] HTTP exception thrown: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-509c30d4-48bb-444d-8910-30cb183c08c6 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Request method failure captured: Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 HTTP/1.1 Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6rjO_q_SILVpCNjLiACK4dLaczI5WQ0yj6Bmzq3HpYnibobHy5NkCS2XJMhIpT3o_enGvPijm7DDjxTXLW2kMskScvdHniTy8F8_r3QmUch0O7pZ-4uCSLCTl826MIJ0WkEsn1fvWDiXHeAdRbIk574mryl4Q-LUma7TYBcWT4Rb7g Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: ea214b3e591a44928fd7af5f51095405 Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-DeleteServersTestJSON-496873357 Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:24:39.998226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:24:39.999676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_ea214b3e591a44928fd7af5f51095405", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ea214b3e591a44928fd7af5f51095405"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ea214b3e591a44928fd7af5f51095405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/ea214b3e591a44928fd7af5f51095405"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:24:39.999676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-DeleteServersTestJSON-496873357 Aug 19 15:24:39.999676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: ea214b3e591a44928fd7af5f51095405 Aug 19 15:24:39.999676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-DeleteServersTestJSON-496873357 Aug 19 15:24:39.999676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-DeleteServersTestJSON-496873357-project Aug 19 15:24:39.999676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:24:39.999676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:24:39.999676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 58fa0eb8e5ad41038d447c54bad91a6d Aug 19 15:24:39.999676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-DeleteServersTestJSON-496873357-project Aug 19 15:24:39.999676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:24:39.999676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:39.999676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': '903776c1-6779-4794-81e4-257cbfdb5908'} Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:24:40.000372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:24:40.001464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:24:40.001464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:24:40.001464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:24:40.001464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:24:40.001464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:24:40.001464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:24:40.001464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:24:40.001464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:40.001464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:40.001464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:40.001464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:40.001464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:40.001464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:24:40.001464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:24:40.001464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:24:40.001464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:24:40.001464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. Aug 19 15:24:40.001464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:40.002596 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-509c30d4-48bb-444d-8910-30cb183c08c6 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] Returning 404 to user: Instance 903776c1-6779-4794-81e4-257cbfdb5908 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:24:40.002596 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-509c30d4-48bb-444d-8910-30cb183c08c6 tempest-DeleteServersTestJSON-496873357 tempest-DeleteServersTestJSON-496873357-project] 10.222.0.75 "GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908" status: 404 len: 111 microversion: 2.1 time: 0.035795 Aug 19 15:24:40.002596 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 101/196] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:39 2022] GET /compute/v2.1/servers/903776c1-6779-4794-81e4-257cbfdb5908 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:24:40.510911 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-10a3c4a3-b39c-4f4e-bc4e-f457ffc39a62 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:40.513638 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1b6c6848-7bfa-4641-91a9-dbf45cc57903 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:40.515514 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1b6c6848-7bfa-4641-91a9-dbf45cc57903 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:40.523052 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-10a3c4a3-b39c-4f4e-bc4e-f457ffc39a62 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:40.525449 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b6c6848-7bfa-4641-91a9-dbf45cc57903 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:40.527399 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b6c6848-7bfa-4641-91a9-dbf45cc57903 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:40.528168 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b6c6848-7bfa-4641-91a9-dbf45cc57903 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:40.529144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b6c6848-7bfa-4641-91a9-dbf45cc57903 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:40.529751 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b6c6848-7bfa-4641-91a9-dbf45cc57903 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:40.530360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b6c6848-7bfa-4641-91a9-dbf45cc57903 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:40.542696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10a3c4a3-b39c-4f4e-bc4e-f457ffc39a62 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:40.543377 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10a3c4a3-b39c-4f4e-bc4e-f457ffc39a62 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:40.544076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10a3c4a3-b39c-4f4e-bc4e-f457ffc39a62 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:40.545116 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10a3c4a3-b39c-4f4e-bc4e-f457ffc39a62 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:40.545610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10a3c4a3-b39c-4f4e-bc4e-f457ffc39a62 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:40.549033 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10a3c4a3-b39c-4f4e-bc4e-f457ffc39a62 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:40.581902 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:40.797173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-10a3c4a3-b39c-4f4e-bc4e-f457ffc39a62 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:40.805381 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-10a3c4a3-b39c-4f4e-bc4e-f457ffc39a62 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1497 microversion: 2.1 time: 0.298902 Aug 19 15:24:40.808428 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 96/197] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:40 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1497 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:40.808559 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1b6c6848-7bfa-4641-91a9-dbf45cc57903 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:40.819324 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1b6c6848-7bfa-4641-91a9-dbf45cc57903 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.310668 Aug 19 15:24:40.827815 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 102/198] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:40 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:24:41.316416 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8438b386-641d-45d2-a2bd-9eeb51fe8a53 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:41.317373 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8438b386-641d-45d2-a2bd-9eeb51fe8a53 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:41.346838 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8438b386-641d-45d2-a2bd-9eeb51fe8a53 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:41.347925 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8438b386-641d-45d2-a2bd-9eeb51fe8a53 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:41.348887 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8438b386-641d-45d2-a2bd-9eeb51fe8a53 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:41.351158 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8438b386-641d-45d2-a2bd-9eeb51fe8a53 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:41.352846 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8438b386-641d-45d2-a2bd-9eeb51fe8a53 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:41.353942 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8438b386-641d-45d2-a2bd-9eeb51fe8a53 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:41.407234 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8438b386-641d-45d2-a2bd-9eeb51fe8a53 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:24:41.556954 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8438b386-641d-45d2-a2bd-9eeb51fe8a53 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "DELETE /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 204 len: 0 microversion: 2.1 time: 0.251055 Aug 19 15:24:41.559677 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 97/199] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:24:41 2022] DELETE /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:24:41.567801 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f49cedf9-006b-4bad-b328-29038d492910 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:41.568333 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f49cedf9-006b-4bad-b328-29038d492910 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:41.595422 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f49cedf9-006b-4bad-b328-29038d492910 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:41.596169 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f49cedf9-006b-4bad-b328-29038d492910 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:41.597022 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f49cedf9-006b-4bad-b328-29038d492910 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:41.597740 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f49cedf9-006b-4bad-b328-29038d492910 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:41.598189 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f49cedf9-006b-4bad-b328-29038d492910 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:41.598607 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f49cedf9-006b-4bad-b328-29038d492910 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:41.786735 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f49cedf9-006b-4bad-b328-29038d492910 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:41.796159 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f49cedf9-006b-4bad-b328-29038d492910 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1503 microversion: 2.1 time: 0.232131 Aug 19 15:24:41.797519 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 103/200] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:41 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1503 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:24:41.844778 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0acf3be1-2bf5-4312-9c47-5c230119208a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:41.846394 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0acf3be1-2bf5-4312-9c47-5c230119208a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:41.852679 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0acf3be1-2bf5-4312-9c47-5c230119208a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:41.853176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0acf3be1-2bf5-4312-9c47-5c230119208a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:41.853587 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0acf3be1-2bf5-4312-9c47-5c230119208a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:41.855330 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0acf3be1-2bf5-4312-9c47-5c230119208a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:41.855848 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0acf3be1-2bf5-4312-9c47-5c230119208a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:41.856273 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0acf3be1-2bf5-4312-9c47-5c230119208a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:42.029477 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0acf3be1-2bf5-4312-9c47-5c230119208a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:42.045438 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0acf3be1-2bf5-4312-9c47-5c230119208a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.204344 Aug 19 15:24:42.047224 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 98/201] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:41 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:42.830124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e6ec9b60-f3ca-4026-8e5a-de3c840f189d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:42.831370 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e6ec9b60-f3ca-4026-8e5a-de3c840f189d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:42.841421 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6ec9b60-f3ca-4026-8e5a-de3c840f189d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:42.842363 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6ec9b60-f3ca-4026-8e5a-de3c840f189d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:42.842875 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6ec9b60-f3ca-4026-8e5a-de3c840f189d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:42.844107 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6ec9b60-f3ca-4026-8e5a-de3c840f189d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:42.844736 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6ec9b60-f3ca-4026-8e5a-de3c840f189d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:42.845214 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6ec9b60-f3ca-4026-8e5a-de3c840f189d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:43.069902 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e6ec9b60-f3ca-4026-8e5a-de3c840f189d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:43.073510 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e53ab77a-9edc-45f7-8c4b-e323e385404f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:43.085838 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e53ab77a-9edc-45f7-8c4b-e323e385404f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:43.086736 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e6ec9b60-f3ca-4026-8e5a-de3c840f189d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1503 microversion: 2.1 time: 0.259882 Aug 19 15:24:43.096916 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 104/202] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:42 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1503 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:43.097125 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:43.097125 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e53ab77a-9edc-45f7-8c4b-e323e385404f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:43.097125 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e53ab77a-9edc-45f7-8c4b-e323e385404f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:43.097715 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e53ab77a-9edc-45f7-8c4b-e323e385404f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:43.098762 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e53ab77a-9edc-45f7-8c4b-e323e385404f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:43.099508 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e53ab77a-9edc-45f7-8c4b-e323e385404f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:43.100221 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e53ab77a-9edc-45f7-8c4b-e323e385404f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:43.444449 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e53ab77a-9edc-45f7-8c4b-e323e385404f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:43.460869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e53ab77a-9edc-45f7-8c4b-e323e385404f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.396345 Aug 19 15:24:43.461799 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 99/203] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:43 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:44.116578 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0efadbdc-aa37-44c9-a93c-175ce156fd33 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:44.117268 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0efadbdc-aa37-44c9-a93c-175ce156fd33 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:44.124315 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0efadbdc-aa37-44c9-a93c-175ce156fd33 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:44.124844 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0efadbdc-aa37-44c9-a93c-175ce156fd33 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:44.125267 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0efadbdc-aa37-44c9-a93c-175ce156fd33 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:44.125954 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0efadbdc-aa37-44c9-a93c-175ce156fd33 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:44.126396 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0efadbdc-aa37-44c9-a93c-175ce156fd33 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:44.126804 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0efadbdc-aa37-44c9-a93c-175ce156fd33 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:44.380520 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0efadbdc-aa37-44c9-a93c-175ce156fd33 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:44.397089 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0efadbdc-aa37-44c9-a93c-175ce156fd33 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1503 microversion: 2.1 time: 0.284379 Aug 19 15:24:44.397999 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 105/204] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:44 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1503 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:44.489427 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b720768c-3518-4edd-85e2-1ca462f08871 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:44.490118 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b720768c-3518-4edd-85e2-1ca462f08871 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:44.497522 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b720768c-3518-4edd-85e2-1ca462f08871 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:44.498093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b720768c-3518-4edd-85e2-1ca462f08871 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:44.498614 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b720768c-3518-4edd-85e2-1ca462f08871 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:44.499375 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b720768c-3518-4edd-85e2-1ca462f08871 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:44.499892 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b720768c-3518-4edd-85e2-1ca462f08871 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:44.500380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b720768c-3518-4edd-85e2-1ca462f08871 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:44.746272 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b720768c-3518-4edd-85e2-1ca462f08871 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:44.749897 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:44.754996 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b720768c-3518-4edd-85e2-1ca462f08871 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.269928 Aug 19 15:24:44.756156 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 100/205] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:44 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:45.432132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f4eb5e7f-90a5-4552-a425-b3f18ce30b3d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:45.433918 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f4eb5e7f-90a5-4552-a425-b3f18ce30b3d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:45.439698 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4eb5e7f-90a5-4552-a425-b3f18ce30b3d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:45.440181 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4eb5e7f-90a5-4552-a425-b3f18ce30b3d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:45.440666 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4eb5e7f-90a5-4552-a425-b3f18ce30b3d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:45.441366 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4eb5e7f-90a5-4552-a425-b3f18ce30b3d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:45.441814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4eb5e7f-90a5-4552-a425-b3f18ce30b3d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:45.442234 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4eb5e7f-90a5-4552-a425-b3f18ce30b3d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:45.583972 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f4eb5e7f-90a5-4552-a425-b3f18ce30b3d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:45.593974 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f4eb5e7f-90a5-4552-a425-b3f18ce30b3d tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1503 microversion: 2.1 time: 0.165392 Aug 19 15:24:45.594611 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 106/206] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:45 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:45.781279 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee7008ff-f675-4ff4-b027-a250bdec4e53 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:45.782502 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee7008ff-f675-4ff4-b027-a250bdec4e53 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:45.790832 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee7008ff-f675-4ff4-b027-a250bdec4e53 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:45.791331 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee7008ff-f675-4ff4-b027-a250bdec4e53 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:45.792638 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee7008ff-f675-4ff4-b027-a250bdec4e53 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:45.793346 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee7008ff-f675-4ff4-b027-a250bdec4e53 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:45.793801 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee7008ff-f675-4ff4-b027-a250bdec4e53 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:45.794233 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee7008ff-f675-4ff4-b027-a250bdec4e53 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:46.067994 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-55393aa2-ecc5-4681-98b6-cc74eb91036f tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Action: 'create', calling method: .version_select at 0x7fb533714820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-319176520"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:24:46.135135 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ee7008ff-f675-4ff4-b027-a250bdec4e53 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:46.143534 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee7008ff-f675-4ff4-b027-a250bdec4e53 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.366112 Aug 19 15:24:46.144123 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 101/207] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:45 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:46.403653 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-55393aa2-ecc5-4681-98b6-cc74eb91036f tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.469085 Aug 19 15:24:46.404281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 107/208] 10.222.0.75 () {60 vars in 1155 bytes} [Fri Aug 19 15:24:45 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 471 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 19 15:24:46.416281 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2c5af071-a241-4f9b-b049-1055df321dc0 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Calling method '.version_select at 0x7fb5335c55e0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:46.473524 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2c5af071-a241-4f9b-b049-1055df321dc0 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/4fb402bd-6086-40da-902f-64aa99a14384" status: 200 len: 344 microversion: 2.1 time: 0.060963 Aug 19 15:24:46.474098 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 102/209] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Aug 19 15:24:46 2022] GET /compute/v2.1/os-volumes/4fb402bd-6086-40da-902f-64aa99a14384 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:24:46.617186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f48d253d-e86d-48e2-a429-49533bd79498 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:46.617727 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f48d253d-e86d-48e2-a429-49533bd79498 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:46.624257 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f48d253d-e86d-48e2-a429-49533bd79498 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:46.624768 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f48d253d-e86d-48e2-a429-49533bd79498 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:46.625198 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f48d253d-e86d-48e2-a429-49533bd79498 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:46.625876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f48d253d-e86d-48e2-a429-49533bd79498 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:46.626321 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f48d253d-e86d-48e2-a429-49533bd79498 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:46.626737 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f48d253d-e86d-48e2-a429-49533bd79498 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:46.784413 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f48d253d-e86d-48e2-a429-49533bd79498 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:46.793149 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f48d253d-e86d-48e2-a429-49533bd79498 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1503 microversion: 2.1 time: 0.179476 Aug 19 15:24:46.794387 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 108/210] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:46 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:47.167330 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0a481ba9-8669-4e63-aa66-bc6548c9ed26 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:47.168692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0a481ba9-8669-4e63-aa66-bc6548c9ed26 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:47.169183 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-07a1a4c6-4b74-4790-98e4-75773be5090c req-e8dbe544-bd15-4ca3-a066-19a86a034df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3441cda4-095a-48d3-9e4d-15c5dc40f334", "name": "network-vif-deleted", "tag": "937ee5da-2200-4ee3-9d5a-4b7d31cd9700"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:24:47.176956 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a481ba9-8669-4e63-aa66-bc6548c9ed26 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:47.177467 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a481ba9-8669-4e63-aa66-bc6548c9ed26 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:47.178386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a481ba9-8669-4e63-aa66-bc6548c9ed26 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:47.179098 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a481ba9-8669-4e63-aa66-bc6548c9ed26 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:47.179554 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a481ba9-8669-4e63-aa66-bc6548c9ed26 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:47.179980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a481ba9-8669-4e63-aa66-bc6548c9ed26 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:47.180177 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-07a1a4c6-4b74-4790-98e4-75773be5090c req-e8dbe544-bd15-4ca3-a066-19a86a034df4 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:47.180684 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-07a1a4c6-4b74-4790-98e4-75773be5090c req-e8dbe544-bd15-4ca3-a066-19a86a034df4 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:47.181102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-07a1a4c6-4b74-4790-98e4-75773be5090c req-e8dbe544-bd15-4ca3-a066-19a86a034df4 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:47.195858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-07a1a4c6-4b74-4790-98e4-75773be5090c req-e8dbe544-bd15-4ca3-a066-19a86a034df4 service nova] Creating event network-vif-deleted:937ee5da-2200-4ee3-9d5a-4b7d31cd9700 for instance 3441cda4-095a-48d3-9e4d-15c5dc40f334 on hv-cinder-83538 Aug 19 15:24:47.203065 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-07a1a4c6-4b74-4790-98e4-75773be5090c req-e8dbe544-bd15-4ca3-a066-19a86a034df4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037682 Aug 19 15:24:47.203065 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 109/211] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:24:47.346657 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0a481ba9-8669-4e63-aa66-bc6548c9ed26 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:47.356127 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0a481ba9-8669-4e63-aa66-bc6548c9ed26 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1521 microversion: 2.1 time: 0.193344 Aug 19 15:24:47.357563 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 103/212] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:47 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:47.487933 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d50b1a54-00b4-492a-a1fd-bbfd55ea8619 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Calling method '.version_select at 0x7fb53352fca0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:47.544948 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d50b1a54-00b4-492a-a1fd-bbfd55ea8619 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/4fb402bd-6086-40da-902f-64aa99a14384" status: 200 len: 345 microversion: 2.1 time: 0.060933 Aug 19 15:24:47.545447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 110/213] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Aug 19 15:24:47 2022] GET /compute/v2.1/os-volumes/4fb402bd-6086-40da-902f-64aa99a14384 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:24:47.557529 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b16c0333-4de4-4ab0-bfb1-a4eab05e06ad tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Action: 'create', calling method: .version_select at 0x7fb53348c940>, body: {"snapshot": {"volume_id": "4fb402bd-6086-40da-902f-64aa99a14384", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1284431057"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:24:47.784213 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b16c0333-4de4-4ab0-bfb1-a4eab05e06ad tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.230380 Aug 19 15:24:47.784874 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 104/214] 10.222.0.75 () {60 vars in 1162 bytes} [Fri Aug 19 15:24:47 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:24:47.797919 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-abce1611-e16a-425a-b4c6-d29cec6aeec9 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Calling method '.version_select at 0x7fb5337b1f70>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:47.815132 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5c62304-94ca-4595-85e4-db537e981a21 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:47.815830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5c62304-94ca-4595-85e4-db537e981a21 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:47.824551 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5c62304-94ca-4595-85e4-db537e981a21 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:47.825249 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5c62304-94ca-4595-85e4-db537e981a21 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:47.825857 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5c62304-94ca-4595-85e4-db537e981a21 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:47.826638 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5c62304-94ca-4595-85e4-db537e981a21 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:47.827089 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5c62304-94ca-4595-85e4-db537e981a21 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:47.827507 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5c62304-94ca-4595-85e4-db537e981a21 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:47.837440 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-abce1611-e16a-425a-b4c6-d29cec6aeec9 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e" status: 200 len: 287 microversion: 2.1 time: 0.043266 Aug 19 15:24:47.838113 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 111/215] 10.222.0.75 () {58 vars in 1251 bytes} [Fri Aug 19 15:24:47 2022] GET /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:24:47.849770 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f96da4ac-8f48-4de0-b003-3d45712b0a6b tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Calling method '.version_select at 0x7fb5335e84c0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:47.861438 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5c62304-94ca-4595-85e4-db537e981a21 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:47.862124 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5c62304-94ca-4595-85e4-db537e981a21 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:47.862551 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5c62304-94ca-4595-85e4-db537e981a21 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:47.863189 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-d5c62304-94ca-4595-85e4-db537e981a21 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lazy-loading 'fault' on Instance uuid 3441cda4-095a-48d3-9e4d-15c5dc40f334 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:24:47.881844 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f96da4ac-8f48-4de0-b003-3d45712b0a6b tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035677 Aug 19 15:24:47.882407 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 112/216] 10.222.0.75 () {58 vars in 1140 bytes} [Fri Aug 19 15:24:47 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:24:47.894346 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dd02c941-c6c7-480a-ae4a-3e9a437bf49d tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Calling method '.version_select at 0x7fb5335e8430>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:47.907952 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5c62304-94ca-4595-85e4-db537e981a21 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:47.915861 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5c62304-94ca-4595-85e4-db537e981a21 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1303 microversion: 2.1 time: 0.104599 Aug 19 15:24:47.916754 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 105/217] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:47 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:24:47.925206 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dd02c941-c6c7-480a-ae4a-3e9a437bf49d tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e" status: 200 len: 287 microversion: 2.1 time: 0.034902 Aug 19 15:24:47.925917 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 113/218] 10.222.0.75 () {58 vars in 1251 bytes} [Fri Aug 19 15:24:47 2022] GET /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:24:48.380135 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a46d9236-f1df-44a1-a410-911041214979 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:48.380883 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a46d9236-f1df-44a1-a410-911041214979 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:48.388645 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46d9236-f1df-44a1-a410-911041214979 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:48.389121 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46d9236-f1df-44a1-a410-911041214979 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:48.389544 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46d9236-f1df-44a1-a410-911041214979 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:48.390223 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46d9236-f1df-44a1-a410-911041214979 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:48.390667 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46d9236-f1df-44a1-a410-911041214979 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:48.391080 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46d9236-f1df-44a1-a410-911041214979 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:48.531378 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a46d9236-f1df-44a1-a410-911041214979 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:48.541260 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a46d9236-f1df-44a1-a410-911041214979 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1501 microversion: 2.1 time: 0.165037 Aug 19 15:24:48.542436 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 106/219] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:48 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:48.562584 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-569385a0-a993-4efe-8dbc-22c58b505eb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:48.563307 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-569385a0-a993-4efe-8dbc-22c58b505eb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:48.569720 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-569385a0-a993-4efe-8dbc-22c58b505eb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:48.570203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-569385a0-a993-4efe-8dbc-22c58b505eb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:48.570657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-569385a0-a993-4efe-8dbc-22c58b505eb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:48.571337 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-569385a0-a993-4efe-8dbc-22c58b505eb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:48.571781 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-569385a0-a993-4efe-8dbc-22c58b505eb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:48.572199 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-569385a0-a993-4efe-8dbc-22c58b505eb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:48.720697 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-569385a0-a993-4efe-8dbc-22c58b505eb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:48.728541 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-569385a0-a993-4efe-8dbc-22c58b505eb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1514 microversion: 2.1 time: 0.169809 Aug 19 15:24:48.729139 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 114/220] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:48 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:48.938432 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b5f9df6b-74d1-4d31-9eda-64c97a4af5c0 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:48.939183 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b012080a-63f3-4bb1-8f2c-0879583329a2 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Calling method '.version_select at 0x7fb53379edc0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:48.939564 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b5f9df6b-74d1-4d31-9eda-64c97a4af5c0 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:48.946078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5f9df6b-74d1-4d31-9eda-64c97a4af5c0 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:48.946556 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5f9df6b-74d1-4d31-9eda-64c97a4af5c0 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:48.947069 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5f9df6b-74d1-4d31-9eda-64c97a4af5c0 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:48.947808 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5f9df6b-74d1-4d31-9eda-64c97a4af5c0 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:48.948311 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5f9df6b-74d1-4d31-9eda-64c97a4af5c0 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:48.948805 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5f9df6b-74d1-4d31-9eda-64c97a4af5c0 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:48.976025 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b012080a-63f3-4bb1-8f2c-0879583329a2 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e" status: 200 len: 287 microversion: 2.1 time: 0.041501 Aug 19 15:24:48.982477 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 107/221] 10.222.0.75 () {58 vars in 1251 bytes} [Fri Aug 19 15:24:48 2022] GET /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:24:48.986498 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5f9df6b-74d1-4d31-9eda-64c97a4af5c0 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:48.987135 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5f9df6b-74d1-4d31-9eda-64c97a4af5c0 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:48.987631 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5f9df6b-74d1-4d31-9eda-64c97a4af5c0 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:48.988137 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-b5f9df6b-74d1-4d31-9eda-64c97a4af5c0 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lazy-loading 'fault' on Instance uuid 3441cda4-095a-48d3-9e4d-15c5dc40f334 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:24:49.062808 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b5f9df6b-74d1-4d31-9eda-64c97a4af5c0 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:49.071267 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b5f9df6b-74d1-4d31-9eda-64c97a4af5c0 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1303 microversion: 2.1 time: 0.136646 Aug 19 15:24:49.071857 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 115/222] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:48 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1303 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:49.989877 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5a9f74e6-8fbb-4509-846c-f3177644f35c tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Calling method '.version_select at 0x7fb5334841f0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:50.020173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5a9f74e6-8fbb-4509-846c-f3177644f35c tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e" status: 200 len: 287 microversion: 2.1 time: 0.034567 Aug 19 15:24:50.020762 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 108/223] 10.222.0.75 () {58 vars in 1251 bytes} [Fri Aug 19 15:24:49 2022] GET /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:24:50.093199 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9673987d-32a5-465c-9e58-c40ed72dfb8f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:50.093935 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9673987d-32a5-465c-9e58-c40ed72dfb8f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:50.100130 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9673987d-32a5-465c-9e58-c40ed72dfb8f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:50.100646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9673987d-32a5-465c-9e58-c40ed72dfb8f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:50.101077 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9673987d-32a5-465c-9e58-c40ed72dfb8f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:50.101772 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9673987d-32a5-465c-9e58-c40ed72dfb8f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:50.102222 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9673987d-32a5-465c-9e58-c40ed72dfb8f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:50.102640 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9673987d-32a5-465c-9e58-c40ed72dfb8f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:50.135166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9673987d-32a5-465c-9e58-c40ed72dfb8f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:50.135637 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9673987d-32a5-465c-9e58-c40ed72dfb8f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:50.136082 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9673987d-32a5-465c-9e58-c40ed72dfb8f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:50.136926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-9673987d-32a5-465c-9e58-c40ed72dfb8f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lazy-loading 'fault' on Instance uuid 3441cda4-095a-48d3-9e4d-15c5dc40f334 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:24:50.177797 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9673987d-32a5-465c-9e58-c40ed72dfb8f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:50.186400 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9673987d-32a5-465c-9e58-c40ed72dfb8f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1303 microversion: 2.1 time: 0.097313 Aug 19 15:24:50.186972 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 116/224] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:50 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:51.034042 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c7876c4e-4f43-48e7-ac91-b1e13e1cd994 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Calling method '.version_select at 0x7fb53348caf0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:51.065635 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c7876c4e-4f43-48e7-ac91-b1e13e1cd994 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e" status: 200 len: 287 microversion: 2.1 time: 0.035865 Aug 19 15:24:51.066202 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 109/225] 10.222.0.75 () {58 vars in 1251 bytes} [Fri Aug 19 15:24:51 2022] GET /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:24:51.207307 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a511ce3a-c461-456e-8c63-b82b24fef5df tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:51.207893 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a511ce3a-c461-456e-8c63-b82b24fef5df tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:51.213916 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a511ce3a-c461-456e-8c63-b82b24fef5df tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:51.214478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a511ce3a-c461-456e-8c63-b82b24fef5df tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:51.215025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a511ce3a-c461-456e-8c63-b82b24fef5df tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:51.215766 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a511ce3a-c461-456e-8c63-b82b24fef5df tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:51.216206 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a511ce3a-c461-456e-8c63-b82b24fef5df tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:51.216643 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a511ce3a-c461-456e-8c63-b82b24fef5df tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:51.248749 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a511ce3a-c461-456e-8c63-b82b24fef5df tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:51.249263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a511ce3a-c461-456e-8c63-b82b24fef5df tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:51.249691 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a511ce3a-c461-456e-8c63-b82b24fef5df tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:51.250123 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-a511ce3a-c461-456e-8c63-b82b24fef5df tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lazy-loading 'fault' on Instance uuid 3441cda4-095a-48d3-9e4d-15c5dc40f334 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:24:51.299647 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a511ce3a-c461-456e-8c63-b82b24fef5df tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:51.307728 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a511ce3a-c461-456e-8c63-b82b24fef5df tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 200 len: 1303 microversion: 2.1 time: 0.104357 Aug 19 15:24:51.308873 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 117/226] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:51 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:52.078249 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a9f4ee2d-8306-4f1c-8378-dc417067a395 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Calling method '.version_select at 0x7fb53359b280>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:52.109130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a9f4ee2d-8306-4f1c-8378-dc417067a395 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e" status: 200 len: 288 microversion: 2.1 time: 0.035340 Aug 19 15:24:52.109689 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 110/227] 10.222.0.75 () {58 vars in 1251 bytes} [Fri Aug 19 15:24:52 2022] GET /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:24:52.121752 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4e89a6b9-9470-482c-893c-7a29ed84d280 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Calling method '.version_select at 0x7fb5334d7940>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:52.187324 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4e89a6b9-9470-482c-893c-7a29ed84d280 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "DELETE /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e" status: 202 len: 0 microversion: 2.1 time: 0.070204 Aug 19 15:24:52.188056 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 118/228] 10.222.0.75 () {58 vars in 1254 bytes} [Fri Aug 19 15:24:52 2022] DELETE /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:24:52.199743 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ccb2b707-de0c-47f4-af24-601ab290703d tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Calling method '.version_select at 0x7fb53379edc0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:52.234129 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ccb2b707-de0c-47f4-af24-601ab290703d tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e" status: 200 len: 287 microversion: 2.1 time: 0.041449 Aug 19 15:24:52.234723 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 111/229] 10.222.0.75 () {58 vars in 1251 bytes} [Fri Aug 19 15:24:52 2022] GET /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:24:52.246381 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b81b0e7f-65f5-44da-8223-399e27461579 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:24:52.248940 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b81b0e7f-65f5-44da-8223-399e27461579 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:52.254962 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b81b0e7f-65f5-44da-8223-399e27461579 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:52.255427 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b81b0e7f-65f5-44da-8223-399e27461579 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:52.255855 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b81b0e7f-65f5-44da-8223-399e27461579 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:52.256578 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b81b0e7f-65f5-44da-8223-399e27461579 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:52.257023 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b81b0e7f-65f5-44da-8223-399e27461579 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:52.257443 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b81b0e7f-65f5-44da-8223-399e27461579 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:52.282364 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-b81b0e7f-65f5-44da-8223-399e27461579 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lazy-loading 'flavor' on Instance uuid 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:24:52.330062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-892e659a-4517-4c96-babc-70140a21ddce tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:52.330759 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-892e659a-4517-4c96-babc-70140a21ddce tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: 3441cda4-095a-48d3-9e4d-15c5dc40f334] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:52.337123 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-892e659a-4517-4c96-babc-70140a21ddce tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:52.337662 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-892e659a-4517-4c96-babc-70140a21ddce tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:52.338658 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-892e659a-4517-4c96-babc-70140a21ddce tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:52.338778 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-892e659a-4517-4c96-babc-70140a21ddce tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:52.339262 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-892e659a-4517-4c96-babc-70140a21ddce tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:52.340432 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-892e659a-4517-4c96-babc-70140a21ddce tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:52.354304 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-892e659a-4517-4c96-babc-70140a21ddce tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] HTTP exception thrown: Instance 3441cda4-095a-48d3-9e4d-15c5dc40f334 could not be found. Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-892e659a-4517-4c96-babc-70140a21ddce tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Request method failure captured: Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 HTTP/1.1 Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6skJ0HdUql6JxhKOtU4qAGk8TZGlsJUxAu6DmbJH0_wXSyDwhVppZVpPaaDWSjBh2GjutQFLk-FKjH_ZvzyWod9YofFaPZV9DV_bBOKj7uz82mg6ZBtH0pdks7aQxheC6wUoLajADmqRWJUQO9zxkXdz9wJYdcsG8bh8eatFs3Zwd8 Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: fc839eae8c504e298673b61d4de8b0e5 Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesActionsTest-52913837 Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:24:52.356130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:24:52.357633 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_fc839eae8c504e298673b61d4de8b0e5", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fc839eae8c504e298673b61d4de8b0e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fc839eae8c504e298673b61d4de8b0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/fc839eae8c504e298673b61d4de8b0e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:24:52.357633 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesActionsTest-52913837 Aug 19 15:24:52.357633 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: fc839eae8c504e298673b61d4de8b0e5 Aug 19 15:24:52.357633 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesActionsTest-52913837 Aug 19 15:24:52.357633 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesActionsTest-52913837-project Aug 19 15:24:52.357633 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:24:52.357633 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:24:52.357633 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: 887eceef50b84dde975e15ac9e7da02b Aug 19 15:24:52.357633 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesActionsTest-52913837-project Aug 19 15:24:52.357633 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:24:52.357633 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Instance 3441cda4-095a-48d3-9e4d-15c5dc40f334 could not be found. Aug 19 15:24:52.357633 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': '3441cda4-095a-48d3-9e4d-15c5dc40f334'} Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3441cda4-095a-48d3-9e4d-15c5dc40f334 could not be found. Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:24:52.361836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:24:52.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:24:52.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:24:52.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:24:52.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:24:52.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:24:52.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:24:52.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:24:52.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3441cda4-095a-48d3-9e4d-15c5dc40f334 could not be found. Aug 19 15:24:52.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:52.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:52.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:52.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:52.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:24:52.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:24:52.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:24:52.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:24:52.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3441cda4-095a-48d3-9e4d-15c5dc40f334 could not be found. Aug 19 15:24:52.363176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:52.364529 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-892e659a-4517-4c96-babc-70140a21ddce tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Returning 404 to user: Instance 3441cda4-095a-48d3-9e4d-15c5dc40f334 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:24:52.364529 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-892e659a-4517-4c96-babc-70140a21ddce tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334" status: 404 len: 111 microversion: 2.1 time: 0.031430 Aug 19 15:24:52.364529 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 112/230] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:52 2022] GET /compute/v2.1/servers/3441cda4-095a-48d3-9e4d-15c5dc40f334 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:24:52.384462 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b81b0e7f-65f5-44da-8223-399e27461579 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "POST /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802/action" status: 200 len: 32 microversion: 2.1 time: 0.142235 Aug 19 15:24:52.385148 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 119/231] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Aug 19 15:24:52 2022] POST /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802/action => generated 32 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 15:24:52.395793 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ae4b7193-87b8-485e-a69e-7ff148e43355 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:52.396669 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ae4b7193-87b8-485e-a69e-7ff148e43355 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:52.405002 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae4b7193-87b8-485e-a69e-7ff148e43355 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:52.405602 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae4b7193-87b8-485e-a69e-7ff148e43355 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:52.406466 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae4b7193-87b8-485e-a69e-7ff148e43355 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:52.407229 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae4b7193-87b8-485e-a69e-7ff148e43355 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:52.408102 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae4b7193-87b8-485e-a69e-7ff148e43355 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:52.408102 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae4b7193-87b8-485e-a69e-7ff148e43355 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:52.500862 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-460d3a8f-ee26-4b77-bed1-4ee4fc35ebe4 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-343304889", "imageRef": "27174b76-85e7-4123-a2bc-847959ca59f2", "flavorRef": "452", "networks": [{"uuid": "ab9ca31a-f85c-4567-b91b-7d53a8006dd9"}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:24:52.561337 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ae4b7193-87b8-485e-a69e-7ff148e43355 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:52.569887 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-460d3a8f-ee26-4b77-bed1-4ee4fc35ebe4 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] validate_networks() for [('ab9ca31a-f85c-4567-b91b-7d53a8006dd9', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:24:52.571713 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ae4b7193-87b8-485e-a69e-7ff148e43355 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.179701 Aug 19 15:24:52.572815 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 113/232] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:52 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:52.973312 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-460d3a8f-ee26-4b77-bed1-4ee4fc35ebe4 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:24:52.973758 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-460d3a8f-ee26-4b77-bed1-4ee4fc35ebe4 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:24:52.974221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-460d3a8f-ee26-4b77-bed1-4ee4fc35ebe4 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:24:52.974619 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-460d3a8f-ee26-4b77-bed1-4ee4fc35ebe4 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:24:52.975075 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-460d3a8f-ee26-4b77-bed1-4ee4fc35ebe4 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:24:52.984778 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-460d3a8f-ee26-4b77-bed1-4ee4fc35ebe4 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:52.985252 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-460d3a8f-ee26-4b77-bed1-4ee4fc35ebe4 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:52.985677 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-460d3a8f-ee26-4b77-bed1-4ee4fc35ebe4 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:52.986393 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-460d3a8f-ee26-4b77-bed1-4ee4fc35ebe4 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:52.986868 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-460d3a8f-ee26-4b77-bed1-4ee4fc35ebe4 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:52.987285 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-460d3a8f-ee26-4b77-bed1-4ee4fc35ebe4 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:53.005827 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-460d3a8f-ee26-4b77-bed1-4ee4fc35ebe4 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Getting quotas for project fc839eae8c504e298673b61d4de8b0e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:24:53.009830 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-460d3a8f-ee26-4b77-bed1-4ee4fc35ebe4 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Getting quotas for user 887eceef50b84dde975e15ac9e7da02b and project fc839eae8c504e298673b61d4de8b0e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:24:53.021296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-460d3a8f-ee26-4b77-bed1-4ee4fc35ebe4 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:24:53.023690 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-460d3a8f-ee26-4b77-bed1-4ee4fc35ebe4 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27174b76-85e7-4123-a2bc-847959ca59f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:24:53.074005 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-460d3a8f-ee26-4b77-bed1-4ee4fc35ebe4 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581087 Aug 19 15:24:53.074837 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 120/233] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:24:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 19 15:24:53.086126 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-97696c55-6f07-4253-99e9-37612ae4f8c6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:53.086956 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-97696c55-6f07-4253-99e9-37612ae4f8c6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:53.142588 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-97696c55-6f07-4253-99e9-37612ae4f8c6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:53.149442 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-97696c55-6f07-4253-99e9-37612ae4f8c6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1213 microversion: 2.1 time: 0.067742 Aug 19 15:24:53.150016 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 114/234] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:53 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:53.249012 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6285c5da-d85c-487b-ab57-06f8cf06c73e tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Calling method '.version_select at 0x7fb5335e8d30>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:53.275872 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-6285c5da-d85c-487b-ab57-06f8cf06c73e tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] HTTP exception thrown: Snapshot 8cdb8432-7cbc-4096-b893-3729cd8ec70e could not be found. Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6285c5da-d85c-487b-ab57-06f8cf06c73e tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Request method failure captured: Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e HTTP/1.1 Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6s9xWdiycBxD3DSg4Q3IMDWatJU8nV2zeTB30FvCscD4Xmb8-7_U8q17fKT-auaKM2zcjNA8MNrB0120eLDirLKuITjrFibgXK0W-x47b98Dg3h5RCtuX8aMEmHwjdJD2jc9Msbmryi3rutkzzqTqMsyWeWnE_O7POXEK5EwSzVrmo Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: 79469e5c56d34cd8bc100c03f4bca745 Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-88232380 Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:24:53.279227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:24:53.280475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_79469e5c56d34cd8bc100c03f4bca745", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/79469e5c56d34cd8bc100c03f4bca745"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/79469e5c56d34cd8bc100c03f4bca745"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/79469e5c56d34cd8bc100c03f4bca745"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:24:53.280475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesSnapshotsTestJSON-88232380 Aug 19 15:24:53.280475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 79469e5c56d34cd8bc100c03f4bca745 Aug 19 15:24:53.280475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-88232380 Aug 19 15:24:53.280475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesSnapshotsTestJSON-88232380-project Aug 19 15:24:53.280475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:24:53.280475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:24:53.280475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 98ca64a3f0084d068555aaf30d2a2a3e Aug 19 15:24:53.280475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesSnapshotsTestJSON-88232380-project Aug 19 15:24:53.280475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: Aug 19 15:24:53.280475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Snapshot 8cdb8432-7cbc-4096-b893-3729cd8ec70e could not be found. Aug 19 15:24:53.280475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': '8cdb8432-7cbc-4096-b893-3729cd8ec70e'} Aug 19 15:24:53.280475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:24:53.281256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:53.281256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 19 15:24:53.281256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 19 15:24:53.281256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 19 15:24:53.281256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 19 15:24:53.281256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 19 15:24:53.281256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 19 15:24:53.281256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 15:24:53.281256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 15:24:53.281256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 15:24:53.281256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 15:24:53.281256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 15:24:53.281256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 15:24:53.281256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 15:24:53.281256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 15:24:53.281256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8cdb8432-7cbc-4096-b893-3729cd8ec70e could not be found. (HTTP 404) (Request-ID: req-a089f4bf-e31f-4398-9b49-3c0d7e3438ee) Aug 19 15:24:53.281256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:53.281256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 15:24:53.282244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8cdb8432-7cbc-4096-b893-3729cd8ec70e could not be found. Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 19 15:24:53.283296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:24:53.285733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8cdb8432-7cbc-4096-b893-3729cd8ec70e could not be found. Aug 19 15:24:53.285733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:53.285733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:53.285733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:53.285733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:53.285733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:24:53.285733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:24:53.285733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:24:53.285733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:24:53.285733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8cdb8432-7cbc-4096-b893-3729cd8ec70e could not be found. Aug 19 15:24:53.285733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:53.285733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6285c5da-d85c-487b-ab57-06f8cf06c73e tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Returning 404 to user: Snapshot 8cdb8432-7cbc-4096-b893-3729cd8ec70e could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:24:53.285733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6285c5da-d85c-487b-ab57-06f8cf06c73e tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e" status: 404 len: 111 microversion: 2.1 time: 0.036520 Aug 19 15:24:53.285733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 121/235] 10.222.0.75 () {58 vars in 1251 bytes} [Fri Aug 19 15:24:53 2022] GET /compute/v2.1/os-snapshots/8cdb8432-7cbc-4096-b893-3729cd8ec70e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:24:53.289910 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a4f19b8f-73b1-4048-a938-c2b8671a6673 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Calling method '.version_select at 0x7fb5334841f0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:53.396285 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a4f19b8f-73b1-4048-a938-c2b8671a6673 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/4fb402bd-6086-40da-902f-64aa99a14384" status: 202 len: 0 microversion: 2.1 time: 0.109974 Aug 19 15:24:53.396907 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 115/236] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Aug 19 15:24:53 2022] DELETE /compute/v2.1/os-volumes/4fb402bd-6086-40da-902f-64aa99a14384 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:24:53.409566 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c57e73c9-8aff-43d6-9bf9-a1cb513bc034 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Calling method '.version_select at 0x7fb5335c3d30>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:53.481611 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c57e73c9-8aff-43d6-9bf9-a1cb513bc034 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/4fb402bd-6086-40da-902f-64aa99a14384" status: 200 len: 344 microversion: 2.1 time: 0.072169 Aug 19 15:24:53.481611 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 122/237] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Aug 19 15:24:53 2022] GET /compute/v2.1/os-volumes/4fb402bd-6086-40da-902f-64aa99a14384 => generated 344 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:24:53.592939 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ebd7ac0e-6abc-45ea-92a1-dd3642a9d45d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:53.593556 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ebd7ac0e-6abc-45ea-92a1-dd3642a9d45d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:53.601317 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebd7ac0e-6abc-45ea-92a1-dd3642a9d45d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:53.601866 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebd7ac0e-6abc-45ea-92a1-dd3642a9d45d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:53.602478 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebd7ac0e-6abc-45ea-92a1-dd3642a9d45d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:53.603174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebd7ac0e-6abc-45ea-92a1-dd3642a9d45d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:53.603634 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebd7ac0e-6abc-45ea-92a1-dd3642a9d45d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:53.604056 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebd7ac0e-6abc-45ea-92a1-dd3642a9d45d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:53.761108 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ebd7ac0e-6abc-45ea-92a1-dd3642a9d45d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:53.770327 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ebd7ac0e-6abc-45ea-92a1-dd3642a9d45d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.181244 Aug 19 15:24:53.770854 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 116/238] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:53 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:54.170105 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b9d435f4-ed4f-4282-b1c8-d4b6fb0726fe tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:54.170689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b9d435f4-ed4f-4282-b1c8-d4b6fb0726fe tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:54.177812 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9d435f4-ed4f-4282-b1c8-d4b6fb0726fe tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:54.178326 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9d435f4-ed4f-4282-b1c8-d4b6fb0726fe tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:54.178743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9d435f4-ed4f-4282-b1c8-d4b6fb0726fe tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:54.179726 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9d435f4-ed4f-4282-b1c8-d4b6fb0726fe tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:54.180192 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9d435f4-ed4f-4282-b1c8-d4b6fb0726fe tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:54.180760 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9d435f4-ed4f-4282-b1c8-d4b6fb0726fe tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:54.251052 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b9d435f4-ed4f-4282-b1c8-d4b6fb0726fe tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:54.259674 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b9d435f4-ed4f-4282-b1c8-d4b6fb0726fe tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1273 microversion: 2.1 time: 0.093900 Aug 19 15:24:54.260258 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 123/239] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:54 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:54.492138 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c3f7c9ab-2a5d-41f4-9645-a00c390a6c6d tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Calling method '.version_select at 0x7fb5335a4a60>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:54.526034 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-c3f7c9ab-2a5d-41f4-9645-a00c390a6c6d tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] HTTP exception thrown: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c3f7c9ab-2a5d-41f4-9645-a00c390a6c6d tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Request method failure captured: Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/os-volumes/4fb402bd-6086-40da-902f-64aa99a14384 HTTP/1.1 Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6s9xWdiycBxD3DSg4Q3IMDWatJU8nV2zeTB30FvCscD4Xmb8-7_U8q17fKT-auaKM2zcjNA8MNrB0120eLDirLKuITjrFibgXK0W-x47b98Dg3h5RCtuX8aMEmHwjdJD2jc9Msbmryi3rutkzzqTqMsyWeWnE_O7POXEK5EwSzVrmo Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: 79469e5c56d34cd8bc100c03f4bca745 Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-88232380 Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:24:54.528596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:24:54.529808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_79469e5c56d34cd8bc100c03f4bca745", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/79469e5c56d34cd8bc100c03f4bca745"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/79469e5c56d34cd8bc100c03f4bca745"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/79469e5c56d34cd8bc100c03f4bca745"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:24:54.529808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesSnapshotsTestJSON-88232380 Aug 19 15:24:54.529808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 79469e5c56d34cd8bc100c03f4bca745 Aug 19 15:24:54.529808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-88232380 Aug 19 15:24:54.529808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesSnapshotsTestJSON-88232380-project Aug 19 15:24:54.529808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:24:54.529808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:24:54.529808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: 98ca64a3f0084d068555aaf30d2a2a3e Aug 19 15:24:54.529808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesSnapshotsTestJSON-88232380-project Aug 19 15:24:54.529808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: Aug 19 15:24:54.529808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. Aug 19 15:24:54.529808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': '4fb402bd-6086-40da-902f-64aa99a14384'} Aug 19 15:24:54.529808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. (HTTP 404) (Request-ID: req-b751fe08-bcdb-4170-97d1-0099a664a732) Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:54.530592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 15:24:54.531610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 19 15:24:54.532692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:24:54.533682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. Aug 19 15:24:54.533682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.533682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:54.533682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.533682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:54.533682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:24:54.533682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:24:54.533682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:24:54.533682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:24:54.533682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. Aug 19 15:24:54.533682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.533682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c3f7c9ab-2a5d-41f4-9645-a00c390a6c6d tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Returning 404 to user: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:24:54.533682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c3f7c9ab-2a5d-41f4-9645-a00c390a6c6d tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/4fb402bd-6086-40da-902f-64aa99a14384" status: 404 len: 109 microversion: 2.1 time: 0.041869 Aug 19 15:24:54.533682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 117/240] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Aug 19 15:24:54 2022] GET /compute/v2.1/os-volumes/4fb402bd-6086-40da-902f-64aa99a14384 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:24:54.545279 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fcb49e2a-1d88-4635-a3e5-f7068631fe39 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Calling method '.version_select at 0x7fb5334f4430>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:54.578756 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-fcb49e2a-1d88-4635-a3e5-f7068631fe39 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] HTTP exception thrown: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fcb49e2a-1d88-4635-a3e5-f7068631fe39 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Request method failure captured: Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/os-volumes/4fb402bd-6086-40da-902f-64aa99a14384 HTTP/1.1 Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6s9xWdiycBxD3DSg4Q3IMDWatJU8nV2zeTB30FvCscD4Xmb8-7_U8q17fKT-auaKM2zcjNA8MNrB0120eLDirLKuITjrFibgXK0W-x47b98Dg3h5RCtuX8aMEmHwjdJD2jc9Msbmryi3rutkzzqTqMsyWeWnE_O7POXEK5EwSzVrmo Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: 79469e5c56d34cd8bc100c03f4bca745 Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-88232380 Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:24:54.581150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:24:54.582373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_79469e5c56d34cd8bc100c03f4bca745", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/79469e5c56d34cd8bc100c03f4bca745"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/79469e5c56d34cd8bc100c03f4bca745"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/79469e5c56d34cd8bc100c03f4bca745"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:24:54.582373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesSnapshotsTestJSON-88232380 Aug 19 15:24:54.582373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 79469e5c56d34cd8bc100c03f4bca745 Aug 19 15:24:54.582373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-88232380 Aug 19 15:24:54.582373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesSnapshotsTestJSON-88232380-project Aug 19 15:24:54.582373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:24:54.582373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:24:54.582373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 98ca64a3f0084d068555aaf30d2a2a3e Aug 19 15:24:54.582373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesSnapshotsTestJSON-88232380-project Aug 19 15:24:54.582373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: Aug 19 15:24:54.582373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. Aug 19 15:24:54.582373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': '4fb402bd-6086-40da-902f-64aa99a14384'} Aug 19 15:24:54.582373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. (HTTP 404) (Request-ID: req-49ef6862-7264-402b-a487-51df69357900) Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:54.583170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 19 15:24:54.584327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 19 15:24:54.585394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:24:54.586601 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. Aug 19 15:24:54.586601 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.586601 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:54.586601 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.586601 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:54.586601 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:24:54.586601 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:24:54.586601 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:24:54.586601 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:24:54.586601 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. Aug 19 15:24:54.586601 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.591482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fcb49e2a-1d88-4635-a3e5-f7068631fe39 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Returning 404 to user: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:24:54.592563 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fcb49e2a-1d88-4635-a3e5-f7068631fe39 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/4fb402bd-6086-40da-902f-64aa99a14384" status: 404 len: 109 microversion: 2.1 time: 0.052130 Aug 19 15:24:54.593206 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 124/241] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Aug 19 15:24:54 2022] DELETE /compute/v2.1/os-volumes/4fb402bd-6086-40da-902f-64aa99a14384 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:24:54.602169 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e81ddf7c-a323-45df-b225-4c9878b00bb4 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Calling method '.version_select at 0x7fb5334fb820>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:54.641723 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-e81ddf7c-a323-45df-b225-4c9878b00bb4 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] HTTP exception thrown: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e81ddf7c-a323-45df-b225-4c9878b00bb4 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Request method failure captured: Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/os-volumes/4fb402bd-6086-40da-902f-64aa99a14384 HTTP/1.1 Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6s9xWdiycBxD3DSg4Q3IMDWatJU8nV2zeTB30FvCscD4Xmb8-7_U8q17fKT-auaKM2zcjNA8MNrB0120eLDirLKuITjrFibgXK0W-x47b98Dg3h5RCtuX8aMEmHwjdJD2jc9Msbmryi3rutkzzqTqMsyWeWnE_O7POXEK5EwSzVrmo Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: 79469e5c56d34cd8bc100c03f4bca745 Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-88232380 Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:24:54.644093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:24:54.645330 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_79469e5c56d34cd8bc100c03f4bca745", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/79469e5c56d34cd8bc100c03f4bca745"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/79469e5c56d34cd8bc100c03f4bca745"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/79469e5c56d34cd8bc100c03f4bca745"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:24:54.645330 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesSnapshotsTestJSON-88232380 Aug 19 15:24:54.645330 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 79469e5c56d34cd8bc100c03f4bca745 Aug 19 15:24:54.645330 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-88232380 Aug 19 15:24:54.645330 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesSnapshotsTestJSON-88232380-project Aug 19 15:24:54.645330 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:24:54.645330 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:24:54.645330 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: 98ca64a3f0084d068555aaf30d2a2a3e Aug 19 15:24:54.645330 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesSnapshotsTestJSON-88232380-project Aug 19 15:24:54.645330 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: Aug 19 15:24:54.645330 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. Aug 19 15:24:54.645330 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': '4fb402bd-6086-40da-902f-64aa99a14384'} Aug 19 15:24:54.645330 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. (HTTP 404) (Request-ID: req-703338e2-ee20-4109-b465-8f4324ff11e2) Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:54.646147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 15:24:54.647206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 19 15:24:54.648200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:24:54.649467 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. Aug 19 15:24:54.649467 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.649467 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:24:54.649467 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.649467 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:24:54.649467 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:24:54.649467 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:24:54.649467 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:24:54.649467 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:24:54.649467 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. Aug 19 15:24:54.649467 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:24:54.655053 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e81ddf7c-a323-45df-b225-4c9878b00bb4 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] Returning 404 to user: Volume 4fb402bd-6086-40da-902f-64aa99a14384 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:24:54.655053 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e81ddf7c-a323-45df-b225-4c9878b00bb4 tempest-VolumesSnapshotsTestJSON-88232380 tempest-VolumesSnapshotsTestJSON-88232380-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/4fb402bd-6086-40da-902f-64aa99a14384" status: 404 len: 109 microversion: 2.1 time: 0.053931 Aug 19 15:24:54.655053 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 118/242] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Aug 19 15:24:54 2022] GET /compute/v2.1/os-volumes/4fb402bd-6086-40da-902f-64aa99a14384 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:24:54.795343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f27d4329-ac1d-49af-bca9-977a5f197fe6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:54.796537 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f27d4329-ac1d-49af-bca9-977a5f197fe6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:54.819950 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f27d4329-ac1d-49af-bca9-977a5f197fe6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:54.820371 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f27d4329-ac1d-49af-bca9-977a5f197fe6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:54.820917 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f27d4329-ac1d-49af-bca9-977a5f197fe6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:54.821618 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f27d4329-ac1d-49af-bca9-977a5f197fe6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:54.822079 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f27d4329-ac1d-49af-bca9-977a5f197fe6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:54.822499 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f27d4329-ac1d-49af-bca9-977a5f197fe6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:55.022560 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f27d4329-ac1d-49af-bca9-977a5f197fe6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:55.032341 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f27d4329-ac1d-49af-bca9-977a5f197fe6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.243879 Aug 19 15:24:55.034276 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 125/243] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:54 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:55.282651 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-976e65b5-60b1-4390-b6ea-677d0fba3160 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:55.283294 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-976e65b5-60b1-4390-b6ea-677d0fba3160 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:55.289410 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-976e65b5-60b1-4390-b6ea-677d0fba3160 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:55.289898 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-976e65b5-60b1-4390-b6ea-677d0fba3160 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:55.290551 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-976e65b5-60b1-4390-b6ea-677d0fba3160 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:55.291452 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-976e65b5-60b1-4390-b6ea-677d0fba3160 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:55.292796 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-976e65b5-60b1-4390-b6ea-677d0fba3160 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:55.293292 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-976e65b5-60b1-4390-b6ea-677d0fba3160 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:55.552757 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-976e65b5-60b1-4390-b6ea-677d0fba3160 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:55.563092 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-976e65b5-60b1-4390-b6ea-677d0fba3160 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1313 microversion: 2.1 time: 0.284163 Aug 19 15:24:55.563683 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 119/244] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:55 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:55.859503 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-923515d8-5fe8-4859-97d8-b3804cb03f79 req-fd10fbfa-f232-4271-9ed1-2e41cc9f9f5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3", "tag": "ae6b11ff-3662-45b6-858c-57049b0f3baf"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:24:55.871792 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-923515d8-5fe8-4859-97d8-b3804cb03f79 req-fd10fbfa-f232-4271-9ed1-2e41cc9f9f5b service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:55.872363 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-923515d8-5fe8-4859-97d8-b3804cb03f79 req-fd10fbfa-f232-4271-9ed1-2e41cc9f9f5b service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:55.872844 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-923515d8-5fe8-4859-97d8-b3804cb03f79 req-fd10fbfa-f232-4271-9ed1-2e41cc9f9f5b service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:55.890201 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-923515d8-5fe8-4859-97d8-b3804cb03f79 req-fd10fbfa-f232-4271-9ed1-2e41cc9f9f5b service nova] Creating event network-changed:ae6b11ff-3662-45b6-858c-57049b0f3baf for instance ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 on hv-cinder-83538 Aug 19 15:24:55.895888 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-923515d8-5fe8-4859-97d8-b3804cb03f79 req-fd10fbfa-f232-4271-9ed1-2e41cc9f9f5b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044470 Aug 19 15:24:55.897240 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 126/245] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:24:56.076729 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-97ebf492-0433-4b26-8670-a26076adc472 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:56.078026 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-97ebf492-0433-4b26-8670-a26076adc472 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:56.089040 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97ebf492-0433-4b26-8670-a26076adc472 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:56.090967 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97ebf492-0433-4b26-8670-a26076adc472 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:56.091699 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97ebf492-0433-4b26-8670-a26076adc472 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:56.093195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97ebf492-0433-4b26-8670-a26076adc472 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:56.094942 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97ebf492-0433-4b26-8670-a26076adc472 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:56.096832 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97ebf492-0433-4b26-8670-a26076adc472 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:56.291591 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-97ebf492-0433-4b26-8670-a26076adc472 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:56.302066 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-97ebf492-0433-4b26-8670-a26076adc472 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.234968 Aug 19 15:24:56.303370 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 120/246] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:56 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:56.587225 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0770261d-bc96-4310-8de0-d1bdd6c09896 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:56.588123 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0770261d-bc96-4310-8de0-d1bdd6c09896 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:56.594648 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0770261d-bc96-4310-8de0-d1bdd6c09896 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:56.595286 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0770261d-bc96-4310-8de0-d1bdd6c09896 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:56.596083 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0770261d-bc96-4310-8de0-d1bdd6c09896 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:56.597042 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0770261d-bc96-4310-8de0-d1bdd6c09896 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:56.597619 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0770261d-bc96-4310-8de0-d1bdd6c09896 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:56.598142 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0770261d-bc96-4310-8de0-d1bdd6c09896 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:56.602630 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:56.764813 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0770261d-bc96-4310-8de0-d1bdd6c09896 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:56.776051 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0770261d-bc96-4310-8de0-d1bdd6c09896 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1313 microversion: 2.1 time: 0.192857 Aug 19 15:24:56.788650 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 127/247] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:56 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:57.326158 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e022e778-ef9e-4900-97f4-6cb3c584c7d8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:57.327134 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e022e778-ef9e-4900-97f4-6cb3c584c7d8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:57.338804 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e022e778-ef9e-4900-97f4-6cb3c584c7d8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:57.340226 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e022e778-ef9e-4900-97f4-6cb3c584c7d8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:57.340950 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e022e778-ef9e-4900-97f4-6cb3c584c7d8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:57.342246 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e022e778-ef9e-4900-97f4-6cb3c584c7d8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:57.343069 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e022e778-ef9e-4900-97f4-6cb3c584c7d8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:57.343822 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e022e778-ef9e-4900-97f4-6cb3c584c7d8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:57.577490 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e022e778-ef9e-4900-97f4-6cb3c584c7d8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:57.586483 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e022e778-ef9e-4900-97f4-6cb3c584c7d8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.266285 Aug 19 15:24:57.587166 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 121/248] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:57 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:57.798412 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7d6eb29a-4cec-4351-ba92-659f61c6ce58 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:57.799787 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7d6eb29a-4cec-4351-ba92-659f61c6ce58 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:57.807736 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d6eb29a-4cec-4351-ba92-659f61c6ce58 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:57.808827 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d6eb29a-4cec-4351-ba92-659f61c6ce58 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:57.809544 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d6eb29a-4cec-4351-ba92-659f61c6ce58 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:57.810277 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d6eb29a-4cec-4351-ba92-659f61c6ce58 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:57.810872 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d6eb29a-4cec-4351-ba92-659f61c6ce58 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:57.811325 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d6eb29a-4cec-4351-ba92-659f61c6ce58 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:57.976082 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7d6eb29a-4cec-4351-ba92-659f61c6ce58 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:57.985575 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7d6eb29a-4cec-4351-ba92-659f61c6ce58 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1313 microversion: 2.1 time: 0.190989 Aug 19 15:24:57.999593 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 128/249] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:57 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:58.607741 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e771c27a-0999-44c3-a549-491e523045c5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:58.608294 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e771c27a-0999-44c3-a549-491e523045c5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:58.615897 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e771c27a-0999-44c3-a549-491e523045c5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:58.616380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e771c27a-0999-44c3-a549-491e523045c5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:58.617392 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e771c27a-0999-44c3-a549-491e523045c5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:58.618090 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e771c27a-0999-44c3-a549-491e523045c5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:58.618541 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e771c27a-0999-44c3-a549-491e523045c5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:58.618965 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e771c27a-0999-44c3-a549-491e523045c5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:58.781543 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e771c27a-0999-44c3-a549-491e523045c5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:58.789402 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e771c27a-0999-44c3-a549-491e523045c5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.186199 Aug 19 15:24:58.790316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 122/250] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:58 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:59.006995 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bdd4ff72-aa1c-4a97-8736-a31685837c48 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:59.007512 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bdd4ff72-aa1c-4a97-8736-a31685837c48 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:59.018394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdd4ff72-aa1c-4a97-8736-a31685837c48 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:59.019134 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdd4ff72-aa1c-4a97-8736-a31685837c48 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:59.020016 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdd4ff72-aa1c-4a97-8736-a31685837c48 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:59.021128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdd4ff72-aa1c-4a97-8736-a31685837c48 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:59.021586 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdd4ff72-aa1c-4a97-8736-a31685837c48 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:59.022052 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdd4ff72-aa1c-4a97-8736-a31685837c48 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:59.164571 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bdd4ff72-aa1c-4a97-8736-a31685837c48 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:59.173676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bdd4ff72-aa1c-4a97-8736-a31685837c48 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1313 microversion: 2.1 time: 0.170702 Aug 19 15:24:59.174569 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 129/251] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:59 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:24:59.812803 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-abd1548a-215e-486f-9d95-ddb15c645e35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:24:59.813459 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-abd1548a-215e-486f-9d95-ddb15c645e35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:24:59.819700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abd1548a-215e-486f-9d95-ddb15c645e35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:59.820178 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abd1548a-215e-486f-9d95-ddb15c645e35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:59.820653 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abd1548a-215e-486f-9d95-ddb15c645e35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:59.821337 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abd1548a-215e-486f-9d95-ddb15c645e35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:24:59.821874 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abd1548a-215e-486f-9d95-ddb15c645e35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:24:59.824459 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abd1548a-215e-486f-9d95-ddb15c645e35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:24:59.931616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ce4d082c-4a9a-4720-b5f5-b521aadef30f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-113847371", "imageRef": "27174b76-85e7-4123-a2bc-847959ca59f2", "flavorRef": "452", "networks": [{"uuid": "37d539b3-8a9d-4ad1-b572-f18d00ea3641"}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:24:59.980548 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-abd1548a-215e-486f-9d95-ddb15c645e35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:24:59.991088 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-abd1548a-215e-486f-9d95-ddb15c645e35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.183491 Aug 19 15:24:59.991728 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 123/252] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:24:59 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:00.010631 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-ce4d082c-4a9a-4720-b5f5-b521aadef30f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] validate_networks() for [('37d539b3-8a9d-4ad1-b572-f18d00ea3641', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:25:00.194890 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8f24dc59-cb71-4dc4-b891-e10fc6bec4bb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:00.195497 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8f24dc59-cb71-4dc4-b891-e10fc6bec4bb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:00.201847 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f24dc59-cb71-4dc4-b891-e10fc6bec4bb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:00.202327 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f24dc59-cb71-4dc4-b891-e10fc6bec4bb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:00.202751 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f24dc59-cb71-4dc4-b891-e10fc6bec4bb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:00.203431 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f24dc59-cb71-4dc4-b891-e10fc6bec4bb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:00.203874 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f24dc59-cb71-4dc4-b891-e10fc6bec4bb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:00.204285 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f24dc59-cb71-4dc4-b891-e10fc6bec4bb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:00.425776 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8f24dc59-cb71-4dc4-b891-e10fc6bec4bb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:00.435337 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8f24dc59-cb71-4dc4-b891-e10fc6bec4bb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1313 microversion: 2.1 time: 0.243009 Aug 19 15:25:00.435938 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 124/253] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:00 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:00.454539 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-ce4d082c-4a9a-4720-b5f5-b521aadef30f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:25:00.454955 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-ce4d082c-4a9a-4720-b5f5-b521aadef30f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:25:00.455446 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-ce4d082c-4a9a-4720-b5f5-b521aadef30f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:25:00.455851 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-ce4d082c-4a9a-4720-b5f5-b521aadef30f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:25:00.457107 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-ce4d082c-4a9a-4720-b5f5-b521aadef30f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:25:00.465287 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce4d082c-4a9a-4720-b5f5-b521aadef30f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:00.465758 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce4d082c-4a9a-4720-b5f5-b521aadef30f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:00.466183 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce4d082c-4a9a-4720-b5f5-b521aadef30f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:00.466897 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce4d082c-4a9a-4720-b5f5-b521aadef30f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:00.467342 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce4d082c-4a9a-4720-b5f5-b521aadef30f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:00.467756 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce4d082c-4a9a-4720-b5f5-b521aadef30f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:00.485132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-ce4d082c-4a9a-4720-b5f5-b521aadef30f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Getting quotas for project 42b848bb5725477b8832057b56c9cf4d. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:25:00.489464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-ce4d082c-4a9a-4720-b5f5-b521aadef30f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Getting quotas for user 1be80a6a93454cd8b7128e976308bd4b and project 42b848bb5725477b8832057b56c9cf4d. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:25:00.502194 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ce4d082c-4a9a-4720-b5f5-b521aadef30f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:25:00.504523 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ce4d082c-4a9a-4720-b5f5-b521aadef30f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27174b76-85e7-4123-a2bc-847959ca59f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:25:00.549819 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ce4d082c-4a9a-4720-b5f5-b521aadef30f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622122 Aug 19 15:25:00.550456 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 130/254] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:24:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 19 15:25:00.561726 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1cfb8e3e-2b31-4582-a140-f6ccd09ee671 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:00.562332 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1cfb8e3e-2b31-4582-a140-f6ccd09ee671 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:00.616864 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1cfb8e3e-2b31-4582-a140-f6ccd09ee671 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:00.625501 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1cfb8e3e-2b31-4582-a140-f6ccd09ee671 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1218 microversion: 2.1 time: 0.068165 Aug 19 15:25:00.626084 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 125/255] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:00 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:01.014942 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4843040f-55d9-42d6-b9d1-917c4eaf2a5c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:01.015731 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4843040f-55d9-42d6-b9d1-917c4eaf2a5c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:01.022248 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4843040f-55d9-42d6-b9d1-917c4eaf2a5c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:01.023435 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4843040f-55d9-42d6-b9d1-917c4eaf2a5c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:01.023435 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4843040f-55d9-42d6-b9d1-917c4eaf2a5c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:01.023917 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4843040f-55d9-42d6-b9d1-917c4eaf2a5c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:01.024364 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4843040f-55d9-42d6-b9d1-917c4eaf2a5c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:01.024814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4843040f-55d9-42d6-b9d1-917c4eaf2a5c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:01.182293 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4843040f-55d9-42d6-b9d1-917c4eaf2a5c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:01.190903 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4843040f-55d9-42d6-b9d1-917c4eaf2a5c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.180240 Aug 19 15:25:01.191501 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 131/256] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:01 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:01.455935 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-731e2f17-0e0d-4278-a0ed-8b76cac0e9d8 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:01.456504 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-731e2f17-0e0d-4278-a0ed-8b76cac0e9d8 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:01.465788 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-731e2f17-0e0d-4278-a0ed-8b76cac0e9d8 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:01.466271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-731e2f17-0e0d-4278-a0ed-8b76cac0e9d8 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:01.466700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-731e2f17-0e0d-4278-a0ed-8b76cac0e9d8 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:01.467380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-731e2f17-0e0d-4278-a0ed-8b76cac0e9d8 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:01.467834 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-731e2f17-0e0d-4278-a0ed-8b76cac0e9d8 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:01.468249 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-731e2f17-0e0d-4278-a0ed-8b76cac0e9d8 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:01.599612 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-731e2f17-0e0d-4278-a0ed-8b76cac0e9d8 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:01.607449 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-731e2f17-0e0d-4278-a0ed-8b76cac0e9d8 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1313 microversion: 2.1 time: 0.155521 Aug 19 15:25:01.608011 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 126/257] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:01 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:01.646017 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a4c16a97-e727-4c9e-8a6a-ebe6186d5a38 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:01.646616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a4c16a97-e727-4c9e-8a6a-ebe6186d5a38 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:01.653060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4c16a97-e727-4c9e-8a6a-ebe6186d5a38 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:01.653536 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4c16a97-e727-4c9e-8a6a-ebe6186d5a38 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:01.654045 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4c16a97-e727-4c9e-8a6a-ebe6186d5a38 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:01.654729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4c16a97-e727-4c9e-8a6a-ebe6186d5a38 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:01.655171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4c16a97-e727-4c9e-8a6a-ebe6186d5a38 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:01.655585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4c16a97-e727-4c9e-8a6a-ebe6186d5a38 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:01.720228 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a4c16a97-e727-4c9e-8a6a-ebe6186d5a38 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:01.727846 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a4c16a97-e727-4c9e-8a6a-ebe6186d5a38 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1270 microversion: 2.1 time: 0.085689 Aug 19 15:25:01.728441 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 132/258] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:01 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:02.212163 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7d36547a-3624-4d01-9c2d-4da55b7c2371 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:02.212815 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7d36547a-3624-4d01-9c2d-4da55b7c2371 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:02.218773 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d36547a-3624-4d01-9c2d-4da55b7c2371 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:02.219252 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d36547a-3624-4d01-9c2d-4da55b7c2371 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:02.219680 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d36547a-3624-4d01-9c2d-4da55b7c2371 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:02.220353 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d36547a-3624-4d01-9c2d-4da55b7c2371 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:02.220875 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d36547a-3624-4d01-9c2d-4da55b7c2371 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:02.221241 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d36547a-3624-4d01-9c2d-4da55b7c2371 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:02.349874 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7d36547a-3624-4d01-9c2d-4da55b7c2371 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:02.358477 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7d36547a-3624-4d01-9c2d-4da55b7c2371 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.150178 Aug 19 15:25:02.359036 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 127/259] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:02 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:02.628018 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bdb0a31a-dc14-479a-bc9b-df1b1807a76c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:02.628650 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bdb0a31a-dc14-479a-bc9b-df1b1807a76c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:02.634799 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdb0a31a-dc14-479a-bc9b-df1b1807a76c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:02.635281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdb0a31a-dc14-479a-bc9b-df1b1807a76c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:02.635712 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdb0a31a-dc14-479a-bc9b-df1b1807a76c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:02.637434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdb0a31a-dc14-479a-bc9b-df1b1807a76c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:02.637721 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdb0a31a-dc14-479a-bc9b-df1b1807a76c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:02.638142 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdb0a31a-dc14-479a-bc9b-df1b1807a76c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:02.750997 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2537cc33-6660-45b0-9514-f014ffe27b5e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:02.752319 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2537cc33-6660-45b0-9514-f014ffe27b5e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:02.758394 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2537cc33-6660-45b0-9514-f014ffe27b5e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:02.758897 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2537cc33-6660-45b0-9514-f014ffe27b5e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:02.759312 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2537cc33-6660-45b0-9514-f014ffe27b5e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:02.760003 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2537cc33-6660-45b0-9514-f014ffe27b5e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:02.760756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2537cc33-6660-45b0-9514-f014ffe27b5e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:02.761551 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2537cc33-6660-45b0-9514-f014ffe27b5e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:02.783394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bdb0a31a-dc14-479a-bc9b-df1b1807a76c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:02.791357 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bdb0a31a-dc14-479a-bc9b-df1b1807a76c tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1313 microversion: 2.1 time: 0.167160 Aug 19 15:25:02.791937 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 133/260] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:02 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:02.833429 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2537cc33-6660-45b0-9514-f014ffe27b5e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:02.843209 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2537cc33-6660-45b0-9514-f014ffe27b5e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1270 microversion: 2.1 time: 0.096270 Aug 19 15:25:02.843790 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 128/261] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:02 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:03.379204 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-709561ad-d840-4bd3-adbe-51444f847e6b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:03.379810 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-709561ad-d840-4bd3-adbe-51444f847e6b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:03.386638 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-709561ad-d840-4bd3-adbe-51444f847e6b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:03.387120 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-709561ad-d840-4bd3-adbe-51444f847e6b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:03.387555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-709561ad-d840-4bd3-adbe-51444f847e6b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:03.388311 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-709561ad-d840-4bd3-adbe-51444f847e6b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:03.388793 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-709561ad-d840-4bd3-adbe-51444f847e6b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:03.389788 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-709561ad-d840-4bd3-adbe-51444f847e6b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:03.507238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-e82a89fc-9239-41b0-8c32-46957b589dc6 req-fad0470c-9a0c-442d-93a6-e58c4129697c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3", "name": "network-vif-plugged", "status": "completed", "tag": "ae6b11ff-3662-45b6-858c-57049b0f3baf"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:25:03.522578 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e82a89fc-9239-41b0-8c32-46957b589dc6 req-fad0470c-9a0c-442d-93a6-e58c4129697c service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:03.523165 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e82a89fc-9239-41b0-8c32-46957b589dc6 req-fad0470c-9a0c-442d-93a6-e58c4129697c service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:03.523648 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e82a89fc-9239-41b0-8c32-46957b589dc6 req-fad0470c-9a0c-442d-93a6-e58c4129697c service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:03.539389 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-709561ad-d840-4bd3-adbe-51444f847e6b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:03.549603 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-e82a89fc-9239-41b0-8c32-46957b589dc6 req-fad0470c-9a0c-442d-93a6-e58c4129697c service nova] Creating event network-vif-plugged:ae6b11ff-3662-45b6-858c-57049b0f3baf for instance ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 on hv-cinder-83538 Aug 19 15:25:03.550695 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-709561ad-d840-4bd3-adbe-51444f847e6b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.174742 Aug 19 15:25:03.551887 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 134/262] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:03 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:03.569864 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-e82a89fc-9239-41b0-8c32-46957b589dc6 req-fad0470c-9a0c-442d-93a6-e58c4129697c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066173 Aug 19 15:25:03.570700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 129/263] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:25:03.813311 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d1a23d7c-14f4-44b0-8c7a-6a00efb0a8bf tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:03.813909 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d1a23d7c-14f4-44b0-8c7a-6a00efb0a8bf tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:03.820011 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1a23d7c-14f4-44b0-8c7a-6a00efb0a8bf tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:03.820518 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1a23d7c-14f4-44b0-8c7a-6a00efb0a8bf tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:03.820948 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1a23d7c-14f4-44b0-8c7a-6a00efb0a8bf tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:03.821624 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1a23d7c-14f4-44b0-8c7a-6a00efb0a8bf tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:03.822069 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1a23d7c-14f4-44b0-8c7a-6a00efb0a8bf tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:03.822488 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1a23d7c-14f4-44b0-8c7a-6a00efb0a8bf tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:03.864407 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a47e0d95-2841-498b-a810-08eff4aff3cf tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:03.865080 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a47e0d95-2841-498b-a810-08eff4aff3cf tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:03.871898 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a47e0d95-2841-498b-a810-08eff4aff3cf tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:03.872402 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a47e0d95-2841-498b-a810-08eff4aff3cf tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:03.872879 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a47e0d95-2841-498b-a810-08eff4aff3cf tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:03.873581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a47e0d95-2841-498b-a810-08eff4aff3cf tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:03.874037 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a47e0d95-2841-498b-a810-08eff4aff3cf tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:03.874457 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a47e0d95-2841-498b-a810-08eff4aff3cf tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:03.899144 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:03.963071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a47e0d95-2841-498b-a810-08eff4aff3cf tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:03.971420 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a47e0d95-2841-498b-a810-08eff4aff3cf tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1270 microversion: 2.1 time: 0.111811 Aug 19 15:25:03.971996 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 130/264] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:03 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:03.981508 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d1a23d7c-14f4-44b0-8c7a-6a00efb0a8bf tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:03.989258 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d1a23d7c-14f4-44b0-8c7a-6a00efb0a8bf tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1313 microversion: 2.1 time: 0.179767 Aug 19 15:25:03.989818 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 135/265] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:03 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:04.574674 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ca86ad7f-797e-4c9b-abfb-dd69eba5e045 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:04.575298 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ca86ad7f-797e-4c9b-abfb-dd69eba5e045 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:04.582298 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca86ad7f-797e-4c9b-abfb-dd69eba5e045 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:04.582797 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca86ad7f-797e-4c9b-abfb-dd69eba5e045 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:04.583222 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca86ad7f-797e-4c9b-abfb-dd69eba5e045 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:04.583922 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca86ad7f-797e-4c9b-abfb-dd69eba5e045 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:04.584371 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca86ad7f-797e-4c9b-abfb-dd69eba5e045 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:04.584823 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca86ad7f-797e-4c9b-abfb-dd69eba5e045 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:04.734721 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ca86ad7f-797e-4c9b-abfb-dd69eba5e045 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:04.744570 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ca86ad7f-797e-4c9b-abfb-dd69eba5e045 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.173760 Aug 19 15:25:04.745179 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 131/266] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:04 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:04.992468 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1f58d477-2406-4b64-b2f4-99e48d06c27e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:04.993184 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1f58d477-2406-4b64-b2f4-99e48d06c27e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:05.000617 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f58d477-2406-4b64-b2f4-99e48d06c27e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:05.001183 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f58d477-2406-4b64-b2f4-99e48d06c27e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:05.001684 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f58d477-2406-4b64-b2f4-99e48d06c27e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:05.002445 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f58d477-2406-4b64-b2f4-99e48d06c27e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:05.002983 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f58d477-2406-4b64-b2f4-99e48d06c27e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:05.003631 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f58d477-2406-4b64-b2f4-99e48d06c27e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:05.010583 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e651c9fc-b3b7-46c1-a7f4-8e26fe7aed77 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:05.011563 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e651c9fc-b3b7-46c1-a7f4-8e26fe7aed77 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:05.018689 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e651c9fc-b3b7-46c1-a7f4-8e26fe7aed77 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:05.019174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e651c9fc-b3b7-46c1-a7f4-8e26fe7aed77 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:05.019601 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e651c9fc-b3b7-46c1-a7f4-8e26fe7aed77 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:05.020504 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e651c9fc-b3b7-46c1-a7f4-8e26fe7aed77 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:05.020959 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e651c9fc-b3b7-46c1-a7f4-8e26fe7aed77 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:05.021527 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e651c9fc-b3b7-46c1-a7f4-8e26fe7aed77 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:05.099993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1f58d477-2406-4b64-b2f4-99e48d06c27e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:05.110881 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1f58d477-2406-4b64-b2f4-99e48d06c27e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1276 microversion: 2.1 time: 0.122140 Aug 19 15:25:05.112852 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 136/267] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:04 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1276 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:05.225695 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e651c9fc-b3b7-46c1-a7f4-8e26fe7aed77 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:05.235663 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e651c9fc-b3b7-46c1-a7f4-8e26fe7aed77 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1313 microversion: 2.1 time: 0.228910 Aug 19 15:25:05.236285 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 132/268] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:05 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:05.767313 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9f6dc8ad-6f98-4858-914a-c563d62b17ca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:05.767914 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9f6dc8ad-6f98-4858-914a-c563d62b17ca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:05.774019 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f6dc8ad-6f98-4858-914a-c563d62b17ca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:05.774493 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f6dc8ad-6f98-4858-914a-c563d62b17ca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:05.774919 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f6dc8ad-6f98-4858-914a-c563d62b17ca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:05.775604 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f6dc8ad-6f98-4858-914a-c563d62b17ca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:05.776049 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f6dc8ad-6f98-4858-914a-c563d62b17ca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:05.776497 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f6dc8ad-6f98-4858-914a-c563d62b17ca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:05.919635 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9f6dc8ad-6f98-4858-914a-c563d62b17ca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:05.927897 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9f6dc8ad-6f98-4858-914a-c563d62b17ca tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.164222 Aug 19 15:25:05.928618 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 137/269] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:05 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:06.136705 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6b8480d3-ddd3-4577-b9db-94f278d7d946 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:06.137523 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6b8480d3-ddd3-4577-b9db-94f278d7d946 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:06.144219 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b8480d3-ddd3-4577-b9db-94f278d7d946 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:06.144803 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b8480d3-ddd3-4577-b9db-94f278d7d946 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:06.145234 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b8480d3-ddd3-4577-b9db-94f278d7d946 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:06.145911 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b8480d3-ddd3-4577-b9db-94f278d7d946 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:06.146349 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b8480d3-ddd3-4577-b9db-94f278d7d946 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:06.146756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b8480d3-ddd3-4577-b9db-94f278d7d946 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:06.262768 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4e767e7a-91e5-46c1-9ae2-c9382c5c349b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:06.263394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4e767e7a-91e5-46c1-9ae2-c9382c5c349b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:06.273163 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e767e7a-91e5-46c1-9ae2-c9382c5c349b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:06.273655 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e767e7a-91e5-46c1-9ae2-c9382c5c349b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:06.274088 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e767e7a-91e5-46c1-9ae2-c9382c5c349b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:06.274979 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e767e7a-91e5-46c1-9ae2-c9382c5c349b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:06.275399 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e767e7a-91e5-46c1-9ae2-c9382c5c349b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:06.275994 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e767e7a-91e5-46c1-9ae2-c9382c5c349b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:06.282816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6b8480d3-ddd3-4577-b9db-94f278d7d946 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:06.290485 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6b8480d3-ddd3-4577-b9db-94f278d7d946 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1318 microversion: 2.1 time: 0.157903 Aug 19 15:25:06.291067 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 133/270] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:06 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:06.416328 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4e767e7a-91e5-46c1-9ae2-c9382c5c349b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:06.425506 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4e767e7a-91e5-46c1-9ae2-c9382c5c349b tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1313 microversion: 2.1 time: 0.166872 Aug 19 15:25:06.426300 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 138/271] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:06 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:06.668310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-c4c4b35c-7897-49fd-aea0-ef4770e63dcb req-94ed781a-084b-4551-8975-7183d0d8d5ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7452037-dcc4-487a-8552-4b6d02b2dabb", "tag": "2263536a-3085-4d33-91ef-bd0605452053"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:25:06.680420 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c4c4b35c-7897-49fd-aea0-ef4770e63dcb req-94ed781a-084b-4551-8975-7183d0d8d5ae service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:06.680906 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c4c4b35c-7897-49fd-aea0-ef4770e63dcb req-94ed781a-084b-4551-8975-7183d0d8d5ae service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:06.681331 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c4c4b35c-7897-49fd-aea0-ef4770e63dcb req-94ed781a-084b-4551-8975-7183d0d8d5ae service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:06.693256 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-c4c4b35c-7897-49fd-aea0-ef4770e63dcb req-94ed781a-084b-4551-8975-7183d0d8d5ae service nova] Creating event network-changed:2263536a-3085-4d33-91ef-bd0605452053 for instance e7452037-dcc4-487a-8552-4b6d02b2dabb on hv-cinder-83538 Aug 19 15:25:06.698166 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-c4c4b35c-7897-49fd-aea0-ef4770e63dcb req-94ed781a-084b-4551-8975-7183d0d8d5ae service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034241 Aug 19 15:25:06.699456 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 134/272] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:25:06.964740 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8862129d-6d10-4d72-84bb-d409207ff4ff tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:06.971551 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8862129d-6d10-4d72-84bb-d409207ff4ff tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:07.007914 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8862129d-6d10-4d72-84bb-d409207ff4ff tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:07.008881 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8862129d-6d10-4d72-84bb-d409207ff4ff tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:07.009565 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8862129d-6d10-4d72-84bb-d409207ff4ff tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:07.010432 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8862129d-6d10-4d72-84bb-d409207ff4ff tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:07.011444 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8862129d-6d10-4d72-84bb-d409207ff4ff tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:07.012011 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8862129d-6d10-4d72-84bb-d409207ff4ff tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:07.169674 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8862129d-6d10-4d72-84bb-d409207ff4ff tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:07.177844 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8862129d-6d10-4d72-84bb-d409207ff4ff tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.232085 Aug 19 15:25:07.178433 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 139/273] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:06 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:07.312961 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-666f1b14-a3b4-4198-a961-efe73f41458d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:07.313649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-666f1b14-a3b4-4198-a961-efe73f41458d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:07.320770 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-666f1b14-a3b4-4198-a961-efe73f41458d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:07.321253 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-666f1b14-a3b4-4198-a961-efe73f41458d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:07.321845 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-666f1b14-a3b4-4198-a961-efe73f41458d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:07.322710 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-666f1b14-a3b4-4198-a961-efe73f41458d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:07.323321 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-666f1b14-a3b4-4198-a961-efe73f41458d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:07.323772 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-666f1b14-a3b4-4198-a961-efe73f41458d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:07.449019 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7ef3889a-2877-4cdf-8751-dd3482158607 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:07.450348 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7ef3889a-2877-4cdf-8751-dd3482158607 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:07.456367 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ef3889a-2877-4cdf-8751-dd3482158607 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:07.456880 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ef3889a-2877-4cdf-8751-dd3482158607 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:07.457814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ef3889a-2877-4cdf-8751-dd3482158607 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:07.458568 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ef3889a-2877-4cdf-8751-dd3482158607 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:07.458982 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ef3889a-2877-4cdf-8751-dd3482158607 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:07.460477 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ef3889a-2877-4cdf-8751-dd3482158607 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:07.469910 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-666f1b14-a3b4-4198-a961-efe73f41458d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:07.479361 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-666f1b14-a3b4-4198-a961-efe73f41458d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1318 microversion: 2.1 time: 0.171909 Aug 19 15:25:07.480684 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 135/274] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:07 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:07.612244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7ef3889a-2877-4cdf-8751-dd3482158607 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:07.621876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7ef3889a-2877-4cdf-8751-dd3482158607 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1497 microversion: 2.1 time: 0.178966 Aug 19 15:25:07.622481 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 140/275] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:07 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:08.147147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-29348a6b-62f1-4760-8026-e81b5f42e810 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:08.147848 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-29348a6b-62f1-4760-8026-e81b5f42e810 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:08.155097 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29348a6b-62f1-4760-8026-e81b5f42e810 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:08.156000 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29348a6b-62f1-4760-8026-e81b5f42e810 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:08.156732 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29348a6b-62f1-4760-8026-e81b5f42e810 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:08.157455 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29348a6b-62f1-4760-8026-e81b5f42e810 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:08.157921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29348a6b-62f1-4760-8026-e81b5f42e810 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:08.158346 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29348a6b-62f1-4760-8026-e81b5f42e810 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:08.188882 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-29348a6b-62f1-4760-8026-e81b5f42e810 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:25:08.201670 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-df06eae0-2c8a-48aa-8f11-0361094dff15 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:08.202398 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-df06eae0-2c8a-48aa-8f11-0361094dff15 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:08.204537 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:08.217600 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df06eae0-2c8a-48aa-8f11-0361094dff15 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:08.217987 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df06eae0-2c8a-48aa-8f11-0361094dff15 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:08.218418 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df06eae0-2c8a-48aa-8f11-0361094dff15 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:08.219295 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df06eae0-2c8a-48aa-8f11-0361094dff15 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:08.219934 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df06eae0-2c8a-48aa-8f11-0361094dff15 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:08.220373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df06eae0-2c8a-48aa-8f11-0361094dff15 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:08.314879 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-29348a6b-62f1-4760-8026-e81b5f42e810 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 204 len: 0 microversion: 2.1 time: 0.171852 Aug 19 15:25:08.316028 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 136/276] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:25:08 2022] DELETE /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:25:08.331187 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a453bc62-5fbd-451d-b32c-75f92c83bfb6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:08.331187 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a453bc62-5fbd-451d-b32c-75f92c83bfb6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:08.337109 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a453bc62-5fbd-451d-b32c-75f92c83bfb6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:08.337605 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a453bc62-5fbd-451d-b32c-75f92c83bfb6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:08.338117 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a453bc62-5fbd-451d-b32c-75f92c83bfb6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:08.338922 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a453bc62-5fbd-451d-b32c-75f92c83bfb6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:08.340533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a453bc62-5fbd-451d-b32c-75f92c83bfb6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:08.340835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a453bc62-5fbd-451d-b32c-75f92c83bfb6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:08.419960 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-df06eae0-2c8a-48aa-8f11-0361094dff15 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:08.429034 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-df06eae0-2c8a-48aa-8f11-0361094dff15 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.232542 Aug 19 15:25:08.441686 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 141/277] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:08 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:08.501466 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1ed2232c-77f8-4648-99e1-35744cae80a4 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:08.502712 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1ed2232c-77f8-4648-99e1-35744cae80a4 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:08.514715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ed2232c-77f8-4648-99e1-35744cae80a4 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:08.516409 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ed2232c-77f8-4648-99e1-35744cae80a4 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:08.517632 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ed2232c-77f8-4648-99e1-35744cae80a4 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:08.518665 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ed2232c-77f8-4648-99e1-35744cae80a4 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:08.519105 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ed2232c-77f8-4648-99e1-35744cae80a4 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:08.519693 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ed2232c-77f8-4648-99e1-35744cae80a4 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:08.553006 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a453bc62-5fbd-451d-b32c-75f92c83bfb6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:08.561848 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a453bc62-5fbd-451d-b32c-75f92c83bfb6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1503 microversion: 2.1 time: 0.239921 Aug 19 15:25:08.564545 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 137/278] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:08 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1503 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:08.686909 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1ed2232c-77f8-4648-99e1-35744cae80a4 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:08.695284 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1ed2232c-77f8-4648-99e1-35744cae80a4 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1318 microversion: 2.1 time: 0.197366 Aug 19 15:25:08.695858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 142/279] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:08 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:09.463466 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-00113cfe-9263-41eb-b6b2-2c033de25190 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:09.465113 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-00113cfe-9263-41eb-b6b2-2c033de25190 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:09.471840 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00113cfe-9263-41eb-b6b2-2c033de25190 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:09.472485 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00113cfe-9263-41eb-b6b2-2c033de25190 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:09.472921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00113cfe-9263-41eb-b6b2-2c033de25190 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:09.473621 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00113cfe-9263-41eb-b6b2-2c033de25190 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:09.474073 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00113cfe-9263-41eb-b6b2-2c033de25190 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:09.474497 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00113cfe-9263-41eb-b6b2-2c033de25190 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:09.586256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1feb7a73-040d-4591-b1b3-624f1e642d10 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:09.587096 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1feb7a73-040d-4591-b1b3-624f1e642d10 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:09.596282 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1feb7a73-040d-4591-b1b3-624f1e642d10 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:09.597019 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1feb7a73-040d-4591-b1b3-624f1e642d10 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:09.597474 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1feb7a73-040d-4591-b1b3-624f1e642d10 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:09.598505 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1feb7a73-040d-4591-b1b3-624f1e642d10 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:09.598623 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1feb7a73-040d-4591-b1b3-624f1e642d10 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:09.599058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1feb7a73-040d-4591-b1b3-624f1e642d10 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:09.796988 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-00113cfe-9263-41eb-b6b2-2c033de25190 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:09.820889 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-00113cfe-9263-41eb-b6b2-2c033de25190 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.362770 Aug 19 15:25:09.827805 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 138/280] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:09 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:09.858957 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bfeb38ee-d85c-427c-9e65-7011e86d60c2 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:09.860525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bfeb38ee-d85c-427c-9e65-7011e86d60c2 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:09.867996 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfeb38ee-d85c-427c-9e65-7011e86d60c2 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:09.868721 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfeb38ee-d85c-427c-9e65-7011e86d60c2 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:09.869250 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfeb38ee-d85c-427c-9e65-7011e86d60c2 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:09.870165 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfeb38ee-d85c-427c-9e65-7011e86d60c2 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:09.871040 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfeb38ee-d85c-427c-9e65-7011e86d60c2 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:09.871654 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfeb38ee-d85c-427c-9e65-7011e86d60c2 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:09.880314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1feb7a73-040d-4591-b1b3-624f1e642d10 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:09.899326 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1feb7a73-040d-4591-b1b3-624f1e642d10 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1503 microversion: 2.1 time: 0.320194 Aug 19 15:25:09.900823 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 143/281] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:09 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1503 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:09.907240 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9d709118-dd88-4486-9585-684f7c29be84 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:09.908004 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9d709118-dd88-4486-9585-684f7c29be84 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:09.914858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d709118-dd88-4486-9585-684f7c29be84 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:09.915424 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d709118-dd88-4486-9585-684f7c29be84 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:09.915929 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d709118-dd88-4486-9585-684f7c29be84 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:09.916746 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d709118-dd88-4486-9585-684f7c29be84 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:09.918224 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d709118-dd88-4486-9585-684f7c29be84 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:09.919227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d709118-dd88-4486-9585-684f7c29be84 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:09.945791 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:09.954218 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9d709118-dd88-4486-9585-684f7c29be84 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d/ips" status: 200 len: 146 microversion: 2.1 time: 0.050711 Aug 19 15:25:09.954795 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 144/282] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Aug 19 15:25:09 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d/ips => generated 146 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:25:10.038474 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bfeb38ee-d85c-427c-9e65-7011e86d60c2 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:10.047446 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bfeb38ee-d85c-427c-9e65-7011e86d60c2 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1318 microversion: 2.1 time: 0.209234 Aug 19 15:25:10.048235 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 139/283] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:09 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:10.313189 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5e2c7309-0775-43b3-b79d-c4ddf13e340a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:10.313582 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5e2c7309-0775-43b3-b79d-c4ddf13e340a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:10.320207 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e2c7309-0775-43b3-b79d-c4ddf13e340a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:10.320706 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e2c7309-0775-43b3-b79d-c4ddf13e340a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:10.321125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e2c7309-0775-43b3-b79d-c4ddf13e340a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:10.321799 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e2c7309-0775-43b3-b79d-c4ddf13e340a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:10.322236 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e2c7309-0775-43b3-b79d-c4ddf13e340a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:10.323129 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e2c7309-0775-43b3-b79d-c4ddf13e340a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:10.346578 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5e2c7309-0775-43b3-b79d-c4ddf13e340a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753/ips" status: 200 len: 150 microversion: 2.1 time: 0.037289 Aug 19 15:25:10.347143 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 145/284] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Aug 19 15:25:10 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:25:10.866249 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5e982e60-0948-419d-8a91-956c6f4bcb8d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:10.866855 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5e982e60-0948-419d-8a91-956c6f4bcb8d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:10.877894 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:10.879967 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e982e60-0948-419d-8a91-956c6f4bcb8d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:10.881078 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e982e60-0948-419d-8a91-956c6f4bcb8d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:10.893980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e982e60-0948-419d-8a91-956c6f4bcb8d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:10.895489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e982e60-0948-419d-8a91-956c6f4bcb8d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:10.896123 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e982e60-0948-419d-8a91-956c6f4bcb8d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:10.896746 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e982e60-0948-419d-8a91-956c6f4bcb8d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:10.927112 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b8c0ce02-5c4f-48a9-abf7-42121ba33513 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:10.927831 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b8c0ce02-5c4f-48a9-abf7-42121ba33513 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:10.930026 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=4 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:10.930706 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=12 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:10.938330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8c0ce02-5c4f-48a9-abf7-42121ba33513 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:10.939080 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8c0ce02-5c4f-48a9-abf7-42121ba33513 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:10.939506 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8c0ce02-5c4f-48a9-abf7-42121ba33513 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:10.940609 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8c0ce02-5c4f-48a9-abf7-42121ba33513 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:10.941288 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8c0ce02-5c4f-48a9-abf7-42121ba33513 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:10.941945 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8c0ce02-5c4f-48a9-abf7-42121ba33513 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:11.170124 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5e982e60-0948-419d-8a91-956c6f4bcb8d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:11.188902 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5e982e60-0948-419d-8a91-956c6f4bcb8d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.325506 Aug 19 15:25:11.192581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 140/285] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:10 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:11.196040 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5388383-53c2-4621-8301-e75ee415ef6e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:11.196672 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5388383-53c2-4621-8301-e75ee415ef6e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:11.203381 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5388383-53c2-4621-8301-e75ee415ef6e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:11.203865 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5388383-53c2-4621-8301-e75ee415ef6e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:11.204287 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5388383-53c2-4621-8301-e75ee415ef6e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:11.205197 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5388383-53c2-4621-8301-e75ee415ef6e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:11.205822 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5388383-53c2-4621-8301-e75ee415ef6e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:11.206414 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5388383-53c2-4621-8301-e75ee415ef6e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:11.215658 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b8c0ce02-5c4f-48a9-abf7-42121ba33513 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:11.225641 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b8c0ce02-5c4f-48a9-abf7-42121ba33513 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1503 microversion: 2.1 time: 0.302756 Aug 19 15:25:11.226249 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 146/286] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:10 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1503 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:11.480419 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5388383-53c2-4621-8301-e75ee415ef6e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:11.488427 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5388383-53c2-4621-8301-e75ee415ef6e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1318 microversion: 2.1 time: 0.297230 Aug 19 15:25:11.492424 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 141/287] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:11 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:12.221832 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f5f584b1-545d-43fd-a211-768687fae60f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:12.222453 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f5f584b1-545d-43fd-a211-768687fae60f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:12.228458 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5f584b1-545d-43fd-a211-768687fae60f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:12.228932 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5f584b1-545d-43fd-a211-768687fae60f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:12.229356 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5f584b1-545d-43fd-a211-768687fae60f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:12.231329 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5f584b1-545d-43fd-a211-768687fae60f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:12.231774 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5f584b1-545d-43fd-a211-768687fae60f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:12.232188 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5f584b1-545d-43fd-a211-768687fae60f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:12.247174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-caa38529-b908-4b81-84ff-d1952083dd50 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:12.247779 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-caa38529-b908-4b81-84ff-d1952083dd50 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:12.254101 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caa38529-b908-4b81-84ff-d1952083dd50 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:12.254575 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caa38529-b908-4b81-84ff-d1952083dd50 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:12.255006 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caa38529-b908-4b81-84ff-d1952083dd50 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:12.255693 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caa38529-b908-4b81-84ff-d1952083dd50 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:12.256121 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caa38529-b908-4b81-84ff-d1952083dd50 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:12.256561 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caa38529-b908-4b81-84ff-d1952083dd50 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:12.437733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f5f584b1-545d-43fd-a211-768687fae60f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:12.444850 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-caa38529-b908-4b81-84ff-d1952083dd50 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:12.445531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f5f584b1-545d-43fd-a211-768687fae60f tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.227518 Aug 19 15:25:12.446100 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 147/288] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:12 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:12.453303 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-caa38529-b908-4b81-84ff-d1952083dd50 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1503 microversion: 2.1 time: 0.209991 Aug 19 15:25:12.453868 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 142/289] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:12 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1503 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:12.509934 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7e989e86-6cc7-42ba-b717-37a41987284b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:12.510532 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7e989e86-6cc7-42ba-b717-37a41987284b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:12.517247 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e989e86-6cc7-42ba-b717-37a41987284b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:12.517726 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e989e86-6cc7-42ba-b717-37a41987284b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:12.518157 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e989e86-6cc7-42ba-b717-37a41987284b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:12.518847 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e989e86-6cc7-42ba-b717-37a41987284b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:12.519289 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e989e86-6cc7-42ba-b717-37a41987284b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:12.519705 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e989e86-6cc7-42ba-b717-37a41987284b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:12.656290 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7e989e86-6cc7-42ba-b717-37a41987284b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:12.664343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7e989e86-6cc7-42ba-b717-37a41987284b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1318 microversion: 2.1 time: 0.158146 Aug 19 15:25:12.664927 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 148/290] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:12 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:13.338981 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-b5fda89d-5b0a-44b0-aed6-76a5bb3b1eb9 req-e43eef4f-1a95-4b36-be1b-c94e6b588aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7452037-dcc4-487a-8552-4b6d02b2dabb", "name": "network-vif-plugged", "status": "completed", "tag": "2263536a-3085-4d33-91ef-bd0605452053"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:25:13.344251 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:13.350805 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b5fda89d-5b0a-44b0-aed6-76a5bb3b1eb9 req-e43eef4f-1a95-4b36-be1b-c94e6b588aa6 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:13.351290 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b5fda89d-5b0a-44b0-aed6-76a5bb3b1eb9 req-e43eef4f-1a95-4b36-be1b-c94e6b588aa6 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:13.351805 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b5fda89d-5b0a-44b0-aed6-76a5bb3b1eb9 req-e43eef4f-1a95-4b36-be1b-c94e6b588aa6 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:13.364007 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-b5fda89d-5b0a-44b0-aed6-76a5bb3b1eb9 req-e43eef4f-1a95-4b36-be1b-c94e6b588aa6 service nova] Creating event network-vif-plugged:2263536a-3085-4d33-91ef-bd0605452053 for instance e7452037-dcc4-487a-8552-4b6d02b2dabb on hv-cinder-83538 Aug 19 15:25:13.368932 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-b5fda89d-5b0a-44b0-aed6-76a5bb3b1eb9 req-e43eef4f-1a95-4b36-be1b-c94e6b588aa6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033623 Aug 19 15:25:13.369683 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 143/291] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:25:13.467159 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-292b2dbb-4bf7-450a-9e22-18fdda1cf60e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:13.467704 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-292b2dbb-4bf7-450a-9e22-18fdda1cf60e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:13.473745 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-292b2dbb-4bf7-450a-9e22-18fdda1cf60e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:13.474224 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-292b2dbb-4bf7-450a-9e22-18fdda1cf60e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:13.474644 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-292b2dbb-4bf7-450a-9e22-18fdda1cf60e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:13.474745 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0f048d0e-c89e-4bef-8c8c-36a0abed62eb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:13.475322 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-292b2dbb-4bf7-450a-9e22-18fdda1cf60e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:13.475430 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0f048d0e-c89e-4bef-8c8c-36a0abed62eb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:13.475761 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-292b2dbb-4bf7-450a-9e22-18fdda1cf60e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:13.476171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-292b2dbb-4bf7-450a-9e22-18fdda1cf60e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:13.482177 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f048d0e-c89e-4bef-8c8c-36a0abed62eb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:13.482655 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f048d0e-c89e-4bef-8c8c-36a0abed62eb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:13.483084 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f048d0e-c89e-4bef-8c8c-36a0abed62eb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:13.483766 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f048d0e-c89e-4bef-8c8c-36a0abed62eb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:13.484212 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f048d0e-c89e-4bef-8c8c-36a0abed62eb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:13.484660 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f048d0e-c89e-4bef-8c8c-36a0abed62eb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:13.674020 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-292b2dbb-4bf7-450a-9e22-18fdda1cf60e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:13.680055 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0f048d0e-c89e-4bef-8c8c-36a0abed62eb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:13.687450 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-292b2dbb-4bf7-450a-9e22-18fdda1cf60e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.224479 Aug 19 15:25:13.688139 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 149/292] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:13 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:13.692793 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f96ee684-1709-4e55-b62b-14f2700227e7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:13.693663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f96ee684-1709-4e55-b62b-14f2700227e7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:13.696881 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0f048d0e-c89e-4bef-8c8c-36a0abed62eb tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1503 microversion: 2.1 time: 0.226135 Aug 19 15:25:13.698022 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 144/293] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:13 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1503 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:13.702563 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f96ee684-1709-4e55-b62b-14f2700227e7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:13.703078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f96ee684-1709-4e55-b62b-14f2700227e7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:13.703500 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f96ee684-1709-4e55-b62b-14f2700227e7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:13.704419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f96ee684-1709-4e55-b62b-14f2700227e7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:13.704699 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f96ee684-1709-4e55-b62b-14f2700227e7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:13.705238 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f96ee684-1709-4e55-b62b-14f2700227e7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:13.845677 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f96ee684-1709-4e55-b62b-14f2700227e7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:13.853423 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f96ee684-1709-4e55-b62b-14f2700227e7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1318 microversion: 2.1 time: 0.164200 Aug 19 15:25:13.853997 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 150/294] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:13 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:14.148547 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c9e13119-7283-4a67-90e8-2117c61d106e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33b41f77-8eb9-4550-9b12-f9ae4a3b49a1"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:25:14.151226 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c9e13119-7283-4a67-90e8-2117c61d106e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:14.166984 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9e13119-7283-4a67-90e8-2117c61d106e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:14.168027 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9e13119-7283-4a67-90e8-2117c61d106e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:14.168715 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9e13119-7283-4a67-90e8-2117c61d106e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:14.169913 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9e13119-7283-4a67-90e8-2117c61d106e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:14.170586 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9e13119-7283-4a67-90e8-2117c61d106e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:14.171244 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9e13119-7283-4a67-90e8-2117c61d106e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:14.310448 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d94c2512-7752-4205-a68f-7e6c375cf8ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59e7be76-ad89-45e5-a282-00c247b877c0"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:25:14.314896 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d94c2512-7752-4205-a68f-7e6c375cf8ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:14.321935 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d94c2512-7752-4205-a68f-7e6c375cf8ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:14.322793 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d94c2512-7752-4205-a68f-7e6c375cf8ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:14.324660 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d94c2512-7752-4205-a68f-7e6c375cf8ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:14.326315 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d94c2512-7752-4205-a68f-7e6c375cf8ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:14.327096 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d94c2512-7752-4205-a68f-7e6c375cf8ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:14.327769 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d94c2512-7752-4205-a68f-7e6c375cf8ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:14.862265 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d94c2512-7752-4205-a68f-7e6c375cf8ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "POST /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.556733 Aug 19 15:25:14.868307 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 151/295] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Aug 19 15:25:14 2022] POST /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d/os-volume_attachments => generated 194 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:25:14.881029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-416a0e54-c1f1-484e-a70d-e602bdd10d1e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:14.884764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-416a0e54-c1f1-484e-a70d-e602bdd10d1e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:14.887717 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:14.902696 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-416a0e54-c1f1-484e-a70d-e602bdd10d1e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:14.903559 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-416a0e54-c1f1-484e-a70d-e602bdd10d1e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:14.904517 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-416a0e54-c1f1-484e-a70d-e602bdd10d1e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:14.905430 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-416a0e54-c1f1-484e-a70d-e602bdd10d1e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:14.906038 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-416a0e54-c1f1-484e-a70d-e602bdd10d1e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:14.906626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-416a0e54-c1f1-484e-a70d-e602bdd10d1e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:14.922602 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c9e13119-7283-4a67-90e8-2117c61d106e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "POST /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.778130 Aug 19 15:25:14.927249 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 145/296] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Aug 19 15:25:14 2022] POST /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753/os-volume_attachments => generated 194 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:25:14.945413 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-62599092-ac4b-4e12-92c6-1cce9ffce64f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:14.946150 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-62599092-ac4b-4e12-92c6-1cce9ffce64f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:14.954377 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62599092-ac4b-4e12-92c6-1cce9ffce64f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:14.954881 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62599092-ac4b-4e12-92c6-1cce9ffce64f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:14.955317 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62599092-ac4b-4e12-92c6-1cce9ffce64f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:14.956031 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62599092-ac4b-4e12-92c6-1cce9ffce64f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:14.956553 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62599092-ac4b-4e12-92c6-1cce9ffce64f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:14.957170 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62599092-ac4b-4e12-92c6-1cce9ffce64f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:15.038251 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-62599092-ac4b-4e12-92c6-1cce9ffce64f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:15.047918 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-62599092-ac4b-4e12-92c6-1cce9ffce64f tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1461 microversion: 2.1 time: 0.119300 Aug 19 15:25:15.048686 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 146/297] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:14 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1461 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:15.053938 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-888d4e96-3a82-4720-8144-c501005b2163 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:15.054988 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-888d4e96-3a82-4720-8144-c501005b2163 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:15.063098 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-888d4e96-3a82-4720-8144-c501005b2163 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:15.063845 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-888d4e96-3a82-4720-8144-c501005b2163 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:15.064283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-888d4e96-3a82-4720-8144-c501005b2163 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:15.065070 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-888d4e96-3a82-4720-8144-c501005b2163 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:15.065514 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-888d4e96-3a82-4720-8144-c501005b2163 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:15.065939 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-888d4e96-3a82-4720-8144-c501005b2163 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:15.285786 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-416a0e54-c1f1-484e-a70d-e602bdd10d1e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:15.288316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-888d4e96-3a82-4720-8144-c501005b2163 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:15.313141 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-416a0e54-c1f1-484e-a70d-e602bdd10d1e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.439831 Aug 19 15:25:15.327271 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 152/298] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:14 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:15.327464 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-888d4e96-3a82-4720-8144-c501005b2163 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1318 microversion: 2.1 time: 0.267591 Aug 19 15:25:15.327464 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 147/299] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:15 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:15.327608 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-a58c6015-082f-4548-aabb-bc2600a33609 req-062da56d-31ef-44e4-81a9-eb44d7d2ca57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3", "name": "network-vif-deleted", "tag": "ae6b11ff-3662-45b6-858c-57049b0f3baf"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:25:15.352425 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-a58c6015-082f-4548-aabb-bc2600a33609 req-062da56d-31ef-44e4-81a9-eb44d7d2ca57 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:15.352940 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-a58c6015-082f-4548-aabb-bc2600a33609 req-062da56d-31ef-44e4-81a9-eb44d7d2ca57 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:15.355777 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-a58c6015-082f-4548-aabb-bc2600a33609 req-062da56d-31ef-44e4-81a9-eb44d7d2ca57 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:15.369097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-a58c6015-082f-4548-aabb-bc2600a33609 req-062da56d-31ef-44e4-81a9-eb44d7d2ca57 service nova] Creating event network-vif-deleted:ae6b11ff-3662-45b6-858c-57049b0f3baf for instance ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 on hv-cinder-83538 Aug 19 15:25:15.374872 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-a58c6015-082f-4548-aabb-bc2600a33609 req-062da56d-31ef-44e4-81a9-eb44d7d2ca57 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060068 Aug 19 15:25:15.375501 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 153/300] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:25:16.071584 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3777bef0-3c26-4409-a549-4174c60014e6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:16.072835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3777bef0-3c26-4409-a549-4174c60014e6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:16.079361 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3777bef0-3c26-4409-a549-4174c60014e6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:16.079850 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3777bef0-3c26-4409-a549-4174c60014e6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:16.080411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3777bef0-3c26-4409-a549-4174c60014e6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:16.081169 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3777bef0-3c26-4409-a549-4174c60014e6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:16.081804 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3777bef0-3c26-4409-a549-4174c60014e6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:16.082380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3777bef0-3c26-4409-a549-4174c60014e6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:16.119782 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3777bef0-3c26-4409-a549-4174c60014e6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:16.120510 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3777bef0-3c26-4409-a549-4174c60014e6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:16.121030 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3777bef0-3c26-4409-a549-4174c60014e6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:16.121474 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-3777bef0-3c26-4409-a549-4174c60014e6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lazy-loading 'fault' on Instance uuid ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:25:16.170018 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3777bef0-3c26-4409-a549-4174c60014e6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:16.178165 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3777bef0-3c26-4409-a549-4174c60014e6 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1303 microversion: 2.1 time: 0.110768 Aug 19 15:25:16.178835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 148/301] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:16 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:16.335206 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2cc59852-4a99-4900-85f9-18b80624baea tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:16.336054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2cc59852-4a99-4900-85f9-18b80624baea tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:16.344284 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cc59852-4a99-4900-85f9-18b80624baea tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:16.344792 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cc59852-4a99-4900-85f9-18b80624baea tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:16.345224 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cc59852-4a99-4900-85f9-18b80624baea tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:16.346006 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cc59852-4a99-4900-85f9-18b80624baea tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:16.346500 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cc59852-4a99-4900-85f9-18b80624baea tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:16.346990 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cc59852-4a99-4900-85f9-18b80624baea tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:16.354058 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6ebe937b-aa33-4b7a-a134-db1811ab2ee3 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:16.354671 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6ebe937b-aa33-4b7a-a134-db1811ab2ee3 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:16.361050 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ebe937b-aa33-4b7a-a134-db1811ab2ee3 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:16.361842 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ebe937b-aa33-4b7a-a134-db1811ab2ee3 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:16.363352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ebe937b-aa33-4b7a-a134-db1811ab2ee3 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:16.363352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ebe937b-aa33-4b7a-a134-db1811ab2ee3 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:16.363773 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ebe937b-aa33-4b7a-a134-db1811ab2ee3 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:16.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ebe937b-aa33-4b7a-a134-db1811ab2ee3 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:16.566531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2cc59852-4a99-4900-85f9-18b80624baea tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:16.568640 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6ebe937b-aa33-4b7a-a134-db1811ab2ee3 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:16.575751 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2cc59852-4a99-4900-85f9-18b80624baea tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1500 microversion: 2.1 time: 0.244851 Aug 19 15:25:16.576446 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 154/302] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:16 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1500 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:16.579525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6ebe937b-aa33-4b7a-a134-db1811ab2ee3 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1318 microversion: 2.1 time: 0.229478 Aug 19 15:25:16.580483 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 149/303] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:16 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:16.596505 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8622c66a-a673-4b80-8173-1d8adcc7b899 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11605a40-f3dc-4788-b940-ad7b7661bb39"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:25:16.598939 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8622c66a-a673-4b80-8173-1d8adcc7b899 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:16.605865 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8622c66a-a673-4b80-8173-1d8adcc7b899 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:16.608984 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8622c66a-a673-4b80-8173-1d8adcc7b899 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:16.609533 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8622c66a-a673-4b80-8173-1d8adcc7b899 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:16.610307 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8622c66a-a673-4b80-8173-1d8adcc7b899 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:16.610726 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8622c66a-a673-4b80-8173-1d8adcc7b899 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:16.611151 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8622c66a-a673-4b80-8173-1d8adcc7b899 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:16.639858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-8622c66a-a673-4b80-8173-1d8adcc7b899 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] HTTP exception thrown: Cannot 'attach_volume' instance 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 while it is in vm_state rescued Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8622c66a-a673-4b80-8173-1d8adcc7b899 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Request method failure captured: Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: POST /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802/os-volume_attachments HTTP/1.1 Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 74 Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6rldajWYu2a-wna4OYo7oT4PcVjfwOm5e53qr2wAzq1ke5P0YP7OvzwS0BQ7ZlWVHc9-8RfuQH42A1aK3RMPmXHvxct5oXkEXNEyZU87L546gCy6y0evh0UzcyVgOF-eIz1PDrc-6_6aRbz90Zhzpipvod_2wqGIrmzTxACvIsXGwY Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: dcca6c7d30114cd0936eb30381efad7d Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-592584515 Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:25:16.641715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:25:16.643166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_dcca6c7d30114cd0936eb30381efad7d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcca6c7d30114cd0936eb30381efad7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcca6c7d30114cd0936eb30381efad7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/dcca6c7d30114cd0936eb30381efad7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:25:16.643166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-592584515 Aug 19 15:25:16.643166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: dcca6c7d30114cd0936eb30381efad7d Aug 19 15:25:16.643166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-592584515 Aug 19 15:25:16.643166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-ServerRescueNegativeTestJSON-592584515-project Aug 19 15:25:16.643166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:25:16.643166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:25:16.643166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 218f3dd17e6549fc8796eb30e4b48e24 Aug 19 15:25:16.643166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-592584515-project Aug 19 15:25:16.643166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Aug 19 15:25:16.643166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {"volumeAttachment": {"volumeId": "11605a40-f3dc-4788-b940-ad7b7661bb39"}} Aug 19 15:25:16.643166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Cannot 'attach_volume' instance 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 while it is in vm_state rescued Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'server_id': '10c60ba0-a623-41bb-ba6c-e9ff6e6a4802', 'body': {'volumeAttachment': {'volumeId': '11605a40-f3dc-4788-b940-ad7b7661bb39'}}} Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:25:16.644072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 while it is in vm_state rescued Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:25:16.645729 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:25:16.646858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:25:16.646858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:25:16.646858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 while it is in vm_state rescued Aug 19 15:25:16.646858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:25:16.646858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8622c66a-a673-4b80-8173-1d8adcc7b899 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Returning 409 to user: Cannot 'attach_volume' instance 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 while it is in vm_state rescued {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:25:16.646858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8622c66a-a673-4b80-8173-1d8adcc7b899 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "POST /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050722 Aug 19 15:25:16.646858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 155/304] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Aug 19 15:25:16 2022] POST /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 19 15:25:16.653459 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b5c17305-ead3-4b1b-a6fb-35ec651e316e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:25:16.654199 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b5c17305-ead3-4b1b-a6fb-35ec651e316e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:16.660315 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5c17305-ead3-4b1b-a6fb-35ec651e316e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:16.661028 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5c17305-ead3-4b1b-a6fb-35ec651e316e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:16.661623 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5c17305-ead3-4b1b-a6fb-35ec651e316e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:16.662343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5c17305-ead3-4b1b-a6fb-35ec651e316e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:16.662796 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5c17305-ead3-4b1b-a6fb-35ec651e316e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:16.663196 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5c17305-ead3-4b1b-a6fb-35ec651e316e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:16.779272 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b5c17305-ead3-4b1b-a6fb-35ec651e316e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "POST /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802/action" status: 202 len: 0 microversion: 2.1 time: 0.130309 Aug 19 15:25:16.779908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 150/305] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Aug 19 15:25:16 2022] POST /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:25:16.790264 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-efda632e-53be-435d-a2a5-c2028b908a49 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:16.790964 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-efda632e-53be-435d-a2a5-c2028b908a49 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:16.798901 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efda632e-53be-435d-a2a5-c2028b908a49 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:16.799849 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efda632e-53be-435d-a2a5-c2028b908a49 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:16.800353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efda632e-53be-435d-a2a5-c2028b908a49 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:16.801173 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efda632e-53be-435d-a2a5-c2028b908a49 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:16.801615 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efda632e-53be-435d-a2a5-c2028b908a49 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:16.802031 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efda632e-53be-435d-a2a5-c2028b908a49 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:16.938108 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-efda632e-53be-435d-a2a5-c2028b908a49 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:16.945718 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-efda632e-53be-435d-a2a5-c2028b908a49 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1508 microversion: 2.1 time: 0.160519 Aug 19 15:25:16.946275 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 156/306] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:16 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:17.201009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eb0a4821-eda2-4d08-9c89-9e86e5602bfa tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:17.201870 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eb0a4821-eda2-4d08-9c89-9e86e5602bfa tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:17.219200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb0a4821-eda2-4d08-9c89-9e86e5602bfa tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:17.219689 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb0a4821-eda2-4d08-9c89-9e86e5602bfa tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:17.220121 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb0a4821-eda2-4d08-9c89-9e86e5602bfa tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:17.220852 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb0a4821-eda2-4d08-9c89-9e86e5602bfa tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:17.221303 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb0a4821-eda2-4d08-9c89-9e86e5602bfa tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:17.221786 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb0a4821-eda2-4d08-9c89-9e86e5602bfa tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:17.273914 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb0a4821-eda2-4d08-9c89-9e86e5602bfa tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:17.274493 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb0a4821-eda2-4d08-9c89-9e86e5602bfa tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:17.274922 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb0a4821-eda2-4d08-9c89-9e86e5602bfa tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:17.275440 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-eb0a4821-eda2-4d08-9c89-9e86e5602bfa tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lazy-loading 'fault' on Instance uuid ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:25:17.325239 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eb0a4821-eda2-4d08-9c89-9e86e5602bfa tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887eceef50b84dde975e15ac9e7da02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc839eae8c504e298673b61d4de8b0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:17.333761 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eb0a4821-eda2-4d08-9c89-9e86e5602bfa tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 200 len: 1303 microversion: 2.1 time: 0.138259 Aug 19 15:25:17.334710 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 151/307] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:17 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 1303 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:17.605941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f4228754-119c-4f99-a717-8cd180043d14 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:17.606570 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f4228754-119c-4f99-a717-8cd180043d14 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:17.614383 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4228754-119c-4f99-a717-8cd180043d14 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:17.614877 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4228754-119c-4f99-a717-8cd180043d14 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:17.615316 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4228754-119c-4f99-a717-8cd180043d14 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:17.616025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4228754-119c-4f99-a717-8cd180043d14 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:17.616502 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4228754-119c-4f99-a717-8cd180043d14 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:17.616925 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4228754-119c-4f99-a717-8cd180043d14 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:17.967641 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-be81f631-0bf5-4098-93c6-9cb10a16a48a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:17.968253 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-be81f631-0bf5-4098-93c6-9cb10a16a48a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:17.974423 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be81f631-0bf5-4098-93c6-9cb10a16a48a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:17.974909 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be81f631-0bf5-4098-93c6-9cb10a16a48a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:17.975336 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be81f631-0bf5-4098-93c6-9cb10a16a48a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:17.976031 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be81f631-0bf5-4098-93c6-9cb10a16a48a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:17.976502 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be81f631-0bf5-4098-93c6-9cb10a16a48a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:17.976992 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be81f631-0bf5-4098-93c6-9cb10a16a48a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:17.989148 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f4228754-119c-4f99-a717-8cd180043d14 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:17.998290 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f4228754-119c-4f99-a717-8cd180043d14 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1508 microversion: 2.1 time: 0.396602 Aug 19 15:25:17.998885 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 157/308] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:17 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1508 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:18.145265 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-be81f631-0bf5-4098-93c6-9cb10a16a48a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:18.154822 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-be81f631-0bf5-4098-93c6-9cb10a16a48a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1508 microversion: 2.1 time: 0.191214 Aug 19 15:25:18.155548 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 152/309] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:17 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:18.354829 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-552d3f4f-5047-42b7-bbe5-d59c5f7b44d5 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:18.355609 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-552d3f4f-5047-42b7-bbe5-d59c5f7b44d5 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] [instance: ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:18.362767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-552d3f4f-5047-42b7-bbe5-d59c5f7b44d5 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:18.363362 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-552d3f4f-5047-42b7-bbe5-d59c5f7b44d5 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:18.363867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-552d3f4f-5047-42b7-bbe5-d59c5f7b44d5 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:18.364692 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-552d3f4f-5047-42b7-bbe5-d59c5f7b44d5 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:18.365400 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-552d3f4f-5047-42b7-bbe5-d59c5f7b44d5 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:18.366081 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-552d3f4f-5047-42b7-bbe5-d59c5f7b44d5 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:18.383554 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-552d3f4f-5047-42b7-bbe5-d59c5f7b44d5 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] HTTP exception thrown: Instance ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 could not be found. Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-552d3f4f-5047-42b7-bbe5-d59c5f7b44d5 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Request method failure captured: Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 HTTP/1.1 Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6skJ0HdUql6JxhKOtU4qAGk8TZGlsJUxAu6DmbJH0_wXSyDwhVppZVpPaaDWSjBh2GjutQFLk-FKjH_ZvzyWod9YofFaPZV9DV_bBOKj7uz82mg6ZBtH0pdks7aQxheC6wUoLajADmqRWJUQO9zxkXdz9wJYdcsG8bh8eatFs3Zwd8 Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: fc839eae8c504e298673b61d4de8b0e5 Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesActionsTest-52913837 Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:25:18.385546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:25:18.387926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_fc839eae8c504e298673b61d4de8b0e5", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fc839eae8c504e298673b61d4de8b0e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fc839eae8c504e298673b61d4de8b0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/fc839eae8c504e298673b61d4de8b0e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:25:18.387926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesActionsTest-52913837 Aug 19 15:25:18.387926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: fc839eae8c504e298673b61d4de8b0e5 Aug 19 15:25:18.387926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesActionsTest-52913837 Aug 19 15:25:18.387926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesActionsTest-52913837-project Aug 19 15:25:18.387926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:25:18.387926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:25:18.387926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 887eceef50b84dde975e15ac9e7da02b Aug 19 15:25:18.387926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesActionsTest-52913837-project Aug 19 15:25:18.387926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:25:18.387926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 could not be found. Aug 19 15:25:18.387926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': 'ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3'} Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 could not be found. Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:25:18.388639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:25:18.389724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:25:18.389724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:25:18.389724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:25:18.389724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:25:18.389724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:25:18.389724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:25:18.389724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:25:18.389724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 could not be found. Aug 19 15:25:18.389724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:25:18.389724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:25:18.389724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:25:18.389724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:25:18.389724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:25:18.389724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:25:18.389724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:25:18.389724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:25:18.389724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 could not be found. Aug 19 15:25:18.389724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:25:18.390699 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-552d3f4f-5047-42b7-bbe5-d59c5f7b44d5 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] Returning 404 to user: Instance ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:25:18.390699 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-552d3f4f-5047-42b7-bbe5-d59c5f7b44d5 tempest-VolumesActionsTest-52913837 tempest-VolumesActionsTest-52913837-project] 10.222.0.75 "GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3" status: 404 len: 111 microversion: 2.1 time: 0.037072 Aug 19 15:25:18.390699 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 158/310] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:18 2022] GET /compute/v2.1/servers/ff9fdaf4-5fb0-4bb7-824f-a3a7815c9ef3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:25:19.184893 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ab705c89-9a6d-4c14-80ce-521d4135c122 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:19.185679 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ab705c89-9a6d-4c14-80ce-521d4135c122 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:19.199994 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab705c89-9a6d-4c14-80ce-521d4135c122 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:19.200537 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab705c89-9a6d-4c14-80ce-521d4135c122 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:19.200975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab705c89-9a6d-4c14-80ce-521d4135c122 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:19.201660 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab705c89-9a6d-4c14-80ce-521d4135c122 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:19.202116 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab705c89-9a6d-4c14-80ce-521d4135c122 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:19.202535 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab705c89-9a6d-4c14-80ce-521d4135c122 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:19.410138 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ab705c89-9a6d-4c14-80ce-521d4135c122 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:19.418754 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ab705c89-9a6d-4c14-80ce-521d4135c122 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1508 microversion: 2.1 time: 0.239151 Aug 19 15:25:19.419315 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 153/311] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:19 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1508 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:20.439973 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-55e89f0c-85f9-41ae-a1e9-8bc7b080ca79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:20.441932 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-55e89f0c-85f9-41ae-a1e9-8bc7b080ca79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:20.450575 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55e89f0c-85f9-41ae-a1e9-8bc7b080ca79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:20.452977 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55e89f0c-85f9-41ae-a1e9-8bc7b080ca79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:20.453426 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55e89f0c-85f9-41ae-a1e9-8bc7b080ca79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:20.454560 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55e89f0c-85f9-41ae-a1e9-8bc7b080ca79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:20.455026 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55e89f0c-85f9-41ae-a1e9-8bc7b080ca79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:20.455646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55e89f0c-85f9-41ae-a1e9-8bc7b080ca79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:20.645098 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-55e89f0c-85f9-41ae-a1e9-8bc7b080ca79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:20.647953 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-55e89f0c-85f9-41ae-a1e9-8bc7b080ca79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1508 microversion: 2.1 time: 0.212185 Aug 19 15:25:20.648666 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 159/312] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:20 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1508 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:21.670994 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-87a544f8-3c45-4531-8df7-0d1ea4dc8840 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:21.671699 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-87a544f8-3c45-4531-8df7-0d1ea4dc8840 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:21.679068 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a544f8-3c45-4531-8df7-0d1ea4dc8840 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:21.679691 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a544f8-3c45-4531-8df7-0d1ea4dc8840 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:21.680700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a544f8-3c45-4531-8df7-0d1ea4dc8840 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:21.681616 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a544f8-3c45-4531-8df7-0d1ea4dc8840 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:21.682164 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a544f8-3c45-4531-8df7-0d1ea4dc8840 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:21.683301 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a544f8-3c45-4531-8df7-0d1ea4dc8840 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:21.842653 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-87a544f8-3c45-4531-8df7-0d1ea4dc8840 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:21.850567 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-87a544f8-3c45-4531-8df7-0d1ea4dc8840 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1508 microversion: 2.1 time: 0.184592 Aug 19 15:25:21.851120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 154/313] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:21 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:22.872772 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8549b140-4ee2-4d0b-ab53-282d8cc353ac tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:22.873362 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8549b140-4ee2-4d0b-ab53-282d8cc353ac tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:22.880213 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8549b140-4ee2-4d0b-ab53-282d8cc353ac tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:22.880800 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8549b140-4ee2-4d0b-ab53-282d8cc353ac tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:22.881304 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8549b140-4ee2-4d0b-ab53-282d8cc353ac tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:22.882128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8549b140-4ee2-4d0b-ab53-282d8cc353ac tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:22.882763 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8549b140-4ee2-4d0b-ab53-282d8cc353ac tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:22.883241 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8549b140-4ee2-4d0b-ab53-282d8cc353ac tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:23.030315 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8549b140-4ee2-4d0b-ab53-282d8cc353ac tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:23.048430 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8549b140-4ee2-4d0b-ab53-282d8cc353ac tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1508 microversion: 2.1 time: 0.180003 Aug 19 15:25:23.049660 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 160/314] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:22 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:24.075700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-08ec18a5-d9a8-4c5b-a234-4c68c34c4284 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:24.077029 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-08ec18a5-d9a8-4c5b-a234-4c68c34c4284 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:24.088168 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08ec18a5-d9a8-4c5b-a234-4c68c34c4284 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:24.089561 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08ec18a5-d9a8-4c5b-a234-4c68c34c4284 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:24.092057 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08ec18a5-d9a8-4c5b-a234-4c68c34c4284 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:24.094738 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08ec18a5-d9a8-4c5b-a234-4c68c34c4284 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:24.095231 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08ec18a5-d9a8-4c5b-a234-4c68c34c4284 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:24.101089 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08ec18a5-d9a8-4c5b-a234-4c68c34c4284 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:24.314630 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-08ec18a5-d9a8-4c5b-a234-4c68c34c4284 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:24.328964 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-08ec18a5-d9a8-4c5b-a234-4c68c34c4284 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1514 microversion: 2.1 time: 0.258135 Aug 19 15:25:24.330552 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 155/315] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:24 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1514 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:24.930924 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a3f0521d-5bb9-4f03-bb43-441367d75a64 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:25:24.937636 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3f0521d-5bb9-4f03-bb43-441367d75a64 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:24.938119 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3f0521d-5bb9-4f03-bb43-441367d75a64 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:24.938554 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3f0521d-5bb9-4f03-bb43-441367d75a64 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:24.999792 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a3f0521d-5bb9-4f03-bb43-441367d75a64 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Going to try to stop instance {{(pid=120638) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 19 15:25:25.017113 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:25.044992 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a3f0521d-5bb9-4f03-bb43-441367d75a64 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "POST /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d/action" status: 202 len: 0 microversion: 2.1 time: 0.117832 Aug 19 15:25:25.045625 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 161/316] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Aug 19 15:25:24 2022] POST /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:25:25.053715 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a01ccc38-812b-4ee0-b020-ac57bb2a36d1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:25.054322 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a01ccc38-812b-4ee0-b020-ac57bb2a36d1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:25.060418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a01ccc38-812b-4ee0-b020-ac57bb2a36d1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:25.060919 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a01ccc38-812b-4ee0-b020-ac57bb2a36d1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:25.061350 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a01ccc38-812b-4ee0-b020-ac57bb2a36d1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:25.062035 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a01ccc38-812b-4ee0-b020-ac57bb2a36d1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:25.062484 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a01ccc38-812b-4ee0-b020-ac57bb2a36d1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:25.062906 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a01ccc38-812b-4ee0-b020-ac57bb2a36d1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:25.194826 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a01ccc38-812b-4ee0-b020-ac57bb2a36d1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:25.203094 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a01ccc38-812b-4ee0-b020-ac57bb2a36d1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1724 microversion: 2.1 time: 0.153210 Aug 19 15:25:25.203661 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 156/317] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:25 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:26.225340 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fce1850d-73b7-467c-b224-88f61788139d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:26.225922 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fce1850d-73b7-467c-b224-88f61788139d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:26.233612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fce1850d-73b7-467c-b224-88f61788139d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:26.234123 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fce1850d-73b7-467c-b224-88f61788139d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:26.234535 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fce1850d-73b7-467c-b224-88f61788139d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:26.235200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fce1850d-73b7-467c-b224-88f61788139d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:26.235649 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fce1850d-73b7-467c-b224-88f61788139d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:26.236075 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fce1850d-73b7-467c-b224-88f61788139d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:26.375304 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fce1850d-73b7-467c-b224-88f61788139d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:26.383441 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fce1850d-73b7-467c-b224-88f61788139d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1724 microversion: 2.1 time: 0.163027 Aug 19 15:25:26.383999 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 162/318] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:26 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:27.406098 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-60e45957-9da1-40fa-bd21-3c2f6001d5ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:27.406770 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-60e45957-9da1-40fa-bd21-3c2f6001d5ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:27.414334 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60e45957-9da1-40fa-bd21-3c2f6001d5ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:27.414825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60e45957-9da1-40fa-bd21-3c2f6001d5ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:27.415261 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60e45957-9da1-40fa-bd21-3c2f6001d5ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:27.415976 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60e45957-9da1-40fa-bd21-3c2f6001d5ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:27.416437 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60e45957-9da1-40fa-bd21-3c2f6001d5ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:27.416863 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60e45957-9da1-40fa-bd21-3c2f6001d5ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:27.572764 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-60e45957-9da1-40fa-bd21-3c2f6001d5ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:27.588547 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-60e45957-9da1-40fa-bd21-3c2f6001d5ec tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1724 microversion: 2.1 time: 0.188055 Aug 19 15:25:27.590911 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 157/319] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:27 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:28.075011 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-73def78c-d3f1-400f-85c5-c11c0382b21a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Action: 'create', calling method: .version_select at 0x7fb5335c11f0>, body: {"keypair": {"name": "tempest-keypair-1988567655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqCbyW1W1UFIFIyXxyEQtfaSjM59qbjYqkYfD2Cn5zMoe/DHFPs+vFQrVi29Dzb5XVrd711ndFYqqMIXLA5i9GsMs1edG1EhrsR0D8NF1XIdjFvB380OwrXooeVrIPB3w=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:25:28.094989 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-73def78c-d3f1-400f-85c5-c11c0382b21a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Getting quotas for project dcca6c7d30114cd0936eb30381efad7d. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:25:28.108007 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-73def78c-d3f1-400f-85c5-c11c0382b21a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Getting quotas for user 218f3dd17e6549fc8796eb30e4b48e24 and project dcca6c7d30114cd0936eb30381efad7d. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:25:28.139896 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-73def78c-d3f1-400f-85c5-c11c0382b21a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068824 Aug 19 15:25:28.140983 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 163/320] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Aug 19 15:25:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:25:28.613304 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ca533fd-2b0d-4d13-89fd-b9d619cb87f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:28.613950 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2ca533fd-2b0d-4d13-89fd-b9d619cb87f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:28.621169 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ca533fd-2b0d-4d13-89fd-b9d619cb87f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:28.621679 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ca533fd-2b0d-4d13-89fd-b9d619cb87f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:28.626235 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ca533fd-2b0d-4d13-89fd-b9d619cb87f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:28.626235 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ca533fd-2b0d-4d13-89fd-b9d619cb87f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:28.626235 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ca533fd-2b0d-4d13-89fd-b9d619cb87f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:28.626235 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ca533fd-2b0d-4d13-89fd-b9d619cb87f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:28.813409 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2ca533fd-2b0d-4d13-89fd-b9d619cb87f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:28.825187 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ca533fd-2b0d-4d13-89fd-b9d619cb87f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1724 microversion: 2.1 time: 0.216533 Aug 19 15:25:28.841846 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 158/321] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:28 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:29.849840 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3c32e2cb-1f02-4540-8f21-8d76ba1c0952 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:29.850441 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3c32e2cb-1f02-4540-8f21-8d76ba1c0952 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:29.858018 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c32e2cb-1f02-4540-8f21-8d76ba1c0952 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:29.858728 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c32e2cb-1f02-4540-8f21-8d76ba1c0952 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:29.858949 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c32e2cb-1f02-4540-8f21-8d76ba1c0952 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:29.859641 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c32e2cb-1f02-4540-8f21-8d76ba1c0952 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:29.860082 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c32e2cb-1f02-4540-8f21-8d76ba1c0952 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:29.860696 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c32e2cb-1f02-4540-8f21-8d76ba1c0952 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:29.937060 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-68645290-9174-489d-8437-cce54cb1ddd5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-342053582", "imageRef": "27174b76-85e7-4123-a2bc-847959ca59f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "767088c7-8ee1-471e-80fb-53a5e6370be0"}], "security_groups": [{"name": "tempest-securitygroup--1087777693"}], "key_name": "tempest-keypair-1988567655", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:25:30.019431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3c32e2cb-1f02-4540-8f21-8d76ba1c0952 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:30.030810 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3c32e2cb-1f02-4540-8f21-8d76ba1c0952 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1724 microversion: 2.1 time: 0.185445 Aug 19 15:25:30.031645 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 164/322] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:29 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:31.060819 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d69c070b-85ad-4acd-9fa3-fd04100dfb3d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:31.060819 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d69c070b-85ad-4acd-9fa3-fd04100dfb3d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:31.078094 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d69c070b-85ad-4acd-9fa3-fd04100dfb3d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:31.078574 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d69c070b-85ad-4acd-9fa3-fd04100dfb3d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:31.082184 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d69c070b-85ad-4acd-9fa3-fd04100dfb3d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:31.083393 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d69c070b-85ad-4acd-9fa3-fd04100dfb3d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:31.083961 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d69c070b-85ad-4acd-9fa3-fd04100dfb3d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:31.085056 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d69c070b-85ad-4acd-9fa3-fd04100dfb3d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:31.330192 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d69c070b-85ad-4acd-9fa3-fd04100dfb3d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:31.353648 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d69c070b-85ad-4acd-9fa3-fd04100dfb3d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1724 microversion: 2.1 time: 0.303931 Aug 19 15:25:31.355867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 165/323] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:31 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1724 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:32.380296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a9a694c1-7d31-414a-b266-086ba72c8a46 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:32.381026 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a9a694c1-7d31-414a-b266-086ba72c8a46 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:32.394712 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9a694c1-7d31-414a-b266-086ba72c8a46 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:32.395557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9a694c1-7d31-414a-b266-086ba72c8a46 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:32.396003 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9a694c1-7d31-414a-b266-086ba72c8a46 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:32.397287 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9a694c1-7d31-414a-b266-086ba72c8a46 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:32.398050 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9a694c1-7d31-414a-b266-086ba72c8a46 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:32.398992 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9a694c1-7d31-414a-b266-086ba72c8a46 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:32.662559 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a9a694c1-7d31-414a-b266-086ba72c8a46 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:32.693761 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a9a694c1-7d31-414a-b266-086ba72c8a46 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1724 microversion: 2.1 time: 0.318266 Aug 19 15:25:32.698046 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 166/324] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:32 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:33.720772 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-efdb3ccd-b0e4-4c76-9c08-f92e89878179 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:33.726797 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-efdb3ccd-b0e4-4c76-9c08-f92e89878179 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:33.748051 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efdb3ccd-b0e4-4c76-9c08-f92e89878179 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:33.748893 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efdb3ccd-b0e4-4c76-9c08-f92e89878179 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:33.749638 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efdb3ccd-b0e4-4c76-9c08-f92e89878179 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:33.750723 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efdb3ccd-b0e4-4c76-9c08-f92e89878179 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:33.751474 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efdb3ccd-b0e4-4c76-9c08-f92e89878179 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:33.752261 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efdb3ccd-b0e4-4c76-9c08-f92e89878179 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:34.107457 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-efdb3ccd-b0e4-4c76-9c08-f92e89878179 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:34.121801 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-efdb3ccd-b0e4-4c76-9c08-f92e89878179 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1724 microversion: 2.1 time: 0.403077 Aug 19 15:25:34.123015 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 167/325] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:33 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1724 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:35.029732 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fa838e35-c192-437a-aadd-c35edec9449d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Action: 'create', calling method: .version_select at 0x7fb5334a7ca0>, body: {"keypair": {"name": "tempest-keypair-1366970379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOorvAvNe8dsBTipPWng70tWcza3ZxjsB48Ri8JhUkBmzHyl58Cv7kxtB3yImvFbPtX8KoN8UbEB10QmQJeaTCHBH56VPqjCwHg4G+FSg6dgK/yo75m/imB5w6AuN1hnSg=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:25:35.071675 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-fa838e35-c192-437a-aadd-c35edec9449d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Getting quotas for project cbf14c554d854af5ba8cd910c82d42e0. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:25:35.078684 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-fa838e35-c192-437a-aadd-c35edec9449d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Getting quotas for user 4aaa94a183fb49b79e6383ea783ab76d and project cbf14c554d854af5ba8cd910c82d42e0. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:25:35.117702 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fa838e35-c192-437a-aadd-c35edec9449d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094320 Aug 19 15:25:35.119014 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 168/326] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Aug 19 15:25:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:25:35.145145 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-42a51296-818c-41e3-9eb4-c93aa9e60175 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:35.145762 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-42a51296-818c-41e3-9eb4-c93aa9e60175 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:35.152640 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42a51296-818c-41e3-9eb4-c93aa9e60175 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:35.153144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42a51296-818c-41e3-9eb4-c93aa9e60175 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:35.153831 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42a51296-818c-41e3-9eb4-c93aa9e60175 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:35.154644 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42a51296-818c-41e3-9eb4-c93aa9e60175 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:35.155179 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42a51296-818c-41e3-9eb4-c93aa9e60175 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:35.172905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42a51296-818c-41e3-9eb4-c93aa9e60175 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:35.639641 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-42a51296-818c-41e3-9eb4-c93aa9e60175 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:35.666246 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-42a51296-818c-41e3-9eb4-c93aa9e60175 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1724 microversion: 2.1 time: 0.524689 Aug 19 15:25:35.685224 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 169/327] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:35 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1724 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:36.694324 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4d5f54c5-045c-4c56-814d-13636ce99f14 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:36.694972 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4d5f54c5-045c-4c56-814d-13636ce99f14 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:36.717978 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d5f54c5-045c-4c56-814d-13636ce99f14 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:36.718863 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d5f54c5-045c-4c56-814d-13636ce99f14 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:36.720124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d5f54c5-045c-4c56-814d-13636ce99f14 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:36.732360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d5f54c5-045c-4c56-814d-13636ce99f14 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:36.733418 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d5f54c5-045c-4c56-814d-13636ce99f14 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:36.734067 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d5f54c5-045c-4c56-814d-13636ce99f14 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:37.284499 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4d5f54c5-045c-4c56-814d-13636ce99f14 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:37.313357 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4d5f54c5-045c-4c56-814d-13636ce99f14 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1724 microversion: 2.1 time: 0.623766 Aug 19 15:25:37.318644 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 170/328] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:36 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1724 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:38.343155 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-61cb4b40-252e-4c33-ab2b-bcce90c3fc85 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:38.343937 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-61cb4b40-252e-4c33-ab2b-bcce90c3fc85 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:38.354563 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:38.356099 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61cb4b40-252e-4c33-ab2b-bcce90c3fc85 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:38.356699 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61cb4b40-252e-4c33-ab2b-bcce90c3fc85 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:38.377146 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61cb4b40-252e-4c33-ab2b-bcce90c3fc85 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:38.378265 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61cb4b40-252e-4c33-ab2b-bcce90c3fc85 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:38.379787 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61cb4b40-252e-4c33-ab2b-bcce90c3fc85 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:38.381624 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61cb4b40-252e-4c33-ab2b-bcce90c3fc85 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:38.818884 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:38.890720 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-61cb4b40-252e-4c33-ab2b-bcce90c3fc85 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:38.906230 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-61cb4b40-252e-4c33-ab2b-bcce90c3fc85 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1724 microversion: 2.1 time: 0.567466 Aug 19 15:25:38.907286 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 171/329] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:38 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1724 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:38.979300 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-68645290-9174-489d-8437-cce54cb1ddd5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] validate_networks() for [('767088c7-8ee1-471e-80fb-53a5e6370be0', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:25:39.101723 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a584d12a-ee4c-49ed-874b-9c894f442db4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-733247909", "imageRef": "27174b76-85e7-4123-a2bc-847959ca59f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a74f9df-bea0-4bc2-8022-d4f3c9598ba3"}], "security_groups": [{"name": "tempest-securitygroup--1966041562"}], "key_name": "tempest-keypair-1366970379", "user_data": "}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:25:39.435852 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-a584d12a-ee4c-49ed-874b-9c894f442db4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] validate_networks() for [('6a74f9df-bea0-4bc2-8022-d4f3c9598ba3', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:25:40.428781 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-a584d12a-ee4c-49ed-874b-9c894f442db4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:25:40.429550 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-a584d12a-ee4c-49ed-874b-9c894f442db4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:25:40.430127 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-a584d12a-ee4c-49ed-874b-9c894f442db4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:25:40.430549 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-a584d12a-ee4c-49ed-874b-9c894f442db4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:25:40.431063 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-a584d12a-ee4c-49ed-874b-9c894f442db4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:25:40.449984 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a584d12a-ee4c-49ed-874b-9c894f442db4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:40.450940 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a584d12a-ee4c-49ed-874b-9c894f442db4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:40.450940 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a584d12a-ee4c-49ed-874b-9c894f442db4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:40.451621 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a584d12a-ee4c-49ed-874b-9c894f442db4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:40.454893 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a584d12a-ee4c-49ed-874b-9c894f442db4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:40.455411 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a584d12a-ee4c-49ed-874b-9c894f442db4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:40.499212 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-a584d12a-ee4c-49ed-874b-9c894f442db4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Getting quotas for project cbf14c554d854af5ba8cd910c82d42e0. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:25:40.511187 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-a584d12a-ee4c-49ed-874b-9c894f442db4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Getting quotas for user 4aaa94a183fb49b79e6383ea783ab76d and project cbf14c554d854af5ba8cd910c82d42e0. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:25:40.538887 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a584d12a-ee4c-49ed-874b-9c894f442db4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:25:40.552999 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a584d12a-ee4c-49ed-874b-9c894f442db4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27174b76-85e7-4123-a2bc-847959ca59f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:25:40.576012 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-68645290-9174-489d-8437-cce54cb1ddd5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:25:40.576572 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-68645290-9174-489d-8437-cce54cb1ddd5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:25:40.577108 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-68645290-9174-489d-8437-cce54cb1ddd5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:25:40.577611 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-68645290-9174-489d-8437-cce54cb1ddd5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:25:40.578131 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-68645290-9174-489d-8437-cce54cb1ddd5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:25:40.598453 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68645290-9174-489d-8437-cce54cb1ddd5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:40.600877 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68645290-9174-489d-8437-cce54cb1ddd5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:40.601327 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68645290-9174-489d-8437-cce54cb1ddd5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:40.602085 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68645290-9174-489d-8437-cce54cb1ddd5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:40.602536 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68645290-9174-489d-8437-cce54cb1ddd5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:40.602953 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68645290-9174-489d-8437-cce54cb1ddd5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:40.621975 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a584d12a-ee4c-49ed-874b-9c894f442db4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.524993 Aug 19 15:25:40.629675 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 172/330] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:25:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 19 15:25:40.635263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5938f6ec-fe4c-4eaf-9b7c-18e4524f6025 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:40.636213 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5938f6ec-fe4c-4eaf-9b7c-18e4524f6025 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:40.645052 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5938f6ec-fe4c-4eaf-9b7c-18e4524f6025 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:40.646206 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5938f6ec-fe4c-4eaf-9b7c-18e4524f6025 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:40.647458 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5938f6ec-fe4c-4eaf-9b7c-18e4524f6025 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:40.649013 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5938f6ec-fe4c-4eaf-9b7c-18e4524f6025 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:40.651127 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5938f6ec-fe4c-4eaf-9b7c-18e4524f6025 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:40.652993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5938f6ec-fe4c-4eaf-9b7c-18e4524f6025 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:40.699298 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-68645290-9174-489d-8437-cce54cb1ddd5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Getting quotas for project dcca6c7d30114cd0936eb30381efad7d. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:25:40.705558 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-68645290-9174-489d-8437-cce54cb1ddd5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Getting quotas for user 218f3dd17e6549fc8796eb30e4b48e24 and project dcca6c7d30114cd0936eb30381efad7d. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:25:40.739177 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-68645290-9174-489d-8437-cce54cb1ddd5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:25:40.741871 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-68645290-9174-489d-8437-cce54cb1ddd5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27174b76-85e7-4123-a2bc-847959ca59f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:25:40.849584 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-68645290-9174-489d-8437-cce54cb1ddd5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 10.918492 Aug 19 15:25:40.856833 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 159/331] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:25:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 10926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 15:25:40.899670 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-13356d38-8cfb-4254-a90b-fd899fe07785 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:40.900204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-13356d38-8cfb-4254-a90b-fd899fe07785 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:41.057885 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5938f6ec-fe4c-4eaf-9b7c-18e4524f6025 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:41.071220 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5938f6ec-fe4c-4eaf-9b7c-18e4524f6025 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1724 microversion: 2.1 time: 0.437148 Aug 19 15:25:41.072288 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 173/332] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:40 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1724 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:41.074383 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-13356d38-8cfb-4254-a90b-fd899fe07785 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:41.084899 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-731152a2-6af5-4c3d-bba3-dc9e029c18f7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:41.086891 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-731152a2-6af5-4c3d-bba3-dc9e029c18f7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:41.096599 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-13356d38-8cfb-4254-a90b-fd899fe07785 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1241 microversion: 2.1 time: 0.238382 Aug 19 15:25:41.101040 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 160/333] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:40 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1241 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:41.264752 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-731152a2-6af5-4c3d-bba3-dc9e029c18f7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:41.274634 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-731152a2-6af5-4c3d-bba3-dc9e029c18f7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1245 microversion: 2.1 time: 0.198241 Aug 19 15:25:41.275949 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 174/334] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:41 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1245 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:42.102593 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f632ecda-8d27-4b52-a0d7-84a789bfdd31 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:42.103662 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f632ecda-8d27-4b52-a0d7-84a789bfdd31 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:42.121251 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-453c6fa9-dfed-4319-b1d8-b29242b53176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:42.122724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-453c6fa9-dfed-4319-b1d8-b29242b53176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:42.137621 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-453c6fa9-dfed-4319-b1d8-b29242b53176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:42.140278 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-453c6fa9-dfed-4319-b1d8-b29242b53176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:42.141099 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-453c6fa9-dfed-4319-b1d8-b29242b53176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:42.146131 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f632ecda-8d27-4b52-a0d7-84a789bfdd31 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:42.154302 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f632ecda-8d27-4b52-a0d7-84a789bfdd31 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:42.155481 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f632ecda-8d27-4b52-a0d7-84a789bfdd31 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:42.156454 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-453c6fa9-dfed-4319-b1d8-b29242b53176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:42.158820 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f632ecda-8d27-4b52-a0d7-84a789bfdd31 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:42.160114 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f632ecda-8d27-4b52-a0d7-84a789bfdd31 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:42.160818 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-453c6fa9-dfed-4319-b1d8-b29242b53176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:42.163510 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f632ecda-8d27-4b52-a0d7-84a789bfdd31 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:42.164454 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-453c6fa9-dfed-4319-b1d8-b29242b53176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:42.582017 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-453c6fa9-dfed-4319-b1d8-b29242b53176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:42.615488 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-453c6fa9-dfed-4319-b1d8-b29242b53176 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1237 microversion: 2.1 time: 0.492536 Aug 19 15:25:42.616662 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 175/335] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:42 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1237 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:42.631722 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c85e9d9d-658a-4352-887d-4f31ee96ba9a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:42.648195 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c85e9d9d-658a-4352-887d-4f31ee96ba9a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:42.694937 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c85e9d9d-658a-4352-887d-4f31ee96ba9a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:42.696266 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c85e9d9d-658a-4352-887d-4f31ee96ba9a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:42.697339 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c85e9d9d-658a-4352-887d-4f31ee96ba9a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:42.699024 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c85e9d9d-658a-4352-887d-4f31ee96ba9a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:42.700131 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c85e9d9d-658a-4352-887d-4f31ee96ba9a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:42.700824 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c85e9d9d-658a-4352-887d-4f31ee96ba9a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:42.782474 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f632ecda-8d27-4b52-a0d7-84a789bfdd31 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:42.794590 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f632ecda-8d27-4b52-a0d7-84a789bfdd31 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1724 microversion: 2.1 time: 0.699006 Aug 19 15:25:42.799280 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 161/336] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:42 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1724 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:42.906231 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c85e9d9d-658a-4352-887d-4f31ee96ba9a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:42.928241 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c85e9d9d-658a-4352-887d-4f31ee96ba9a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1297 microversion: 2.1 time: 0.310421 Aug 19 15:25:42.929614 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 176/337] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:42 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1297 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:43.658352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dd36ff52-647f-4c2d-bb7f-0b28d360276f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:43.659074 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dd36ff52-647f-4c2d-bb7f-0b28d360276f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:43.684462 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:43.691879 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd36ff52-647f-4c2d-bb7f-0b28d360276f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:43.696374 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd36ff52-647f-4c2d-bb7f-0b28d360276f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:43.697942 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd36ff52-647f-4c2d-bb7f-0b28d360276f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:43.701496 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd36ff52-647f-4c2d-bb7f-0b28d360276f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:43.705191 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd36ff52-647f-4c2d-bb7f-0b28d360276f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:43.708169 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd36ff52-647f-4c2d-bb7f-0b28d360276f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:43.822666 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8271cffb-201c-4e8a-8a93-5b45fabb9ae1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:43.832863 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8271cffb-201c-4e8a-8a93-5b45fabb9ae1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:43.842474 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8271cffb-201c-4e8a-8a93-5b45fabb9ae1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:43.843346 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8271cffb-201c-4e8a-8a93-5b45fabb9ae1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:43.844061 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8271cffb-201c-4e8a-8a93-5b45fabb9ae1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:43.845046 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8271cffb-201c-4e8a-8a93-5b45fabb9ae1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:43.845676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8271cffb-201c-4e8a-8a93-5b45fabb9ae1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:43.848336 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8271cffb-201c-4e8a-8a93-5b45fabb9ae1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:44.075163 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dd36ff52-647f-4c2d-bb7f-0b28d360276f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:44.089709 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dd36ff52-647f-4c2d-bb7f-0b28d360276f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1311 microversion: 2.1 time: 0.438535 Aug 19 15:25:44.095593 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 162/338] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:43 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1311 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:44.123012 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-31f32870-0424-47a7-8e6a-3d9c406514d0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:44.124952 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-31f32870-0424-47a7-8e6a-3d9c406514d0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:44.155016 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31f32870-0424-47a7-8e6a-3d9c406514d0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:44.155574 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31f32870-0424-47a7-8e6a-3d9c406514d0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:44.158424 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31f32870-0424-47a7-8e6a-3d9c406514d0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:44.162413 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31f32870-0424-47a7-8e6a-3d9c406514d0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:44.166028 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31f32870-0424-47a7-8e6a-3d9c406514d0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:44.166606 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31f32870-0424-47a7-8e6a-3d9c406514d0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:44.365864 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-31f32870-0424-47a7-8e6a-3d9c406514d0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:44.382572 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-31f32870-0424-47a7-8e6a-3d9c406514d0 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1303 microversion: 2.1 time: 0.278052 Aug 19 15:25:44.383648 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 163/339] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:44 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1303 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:44.404725 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b5e994fe-4a07-451c-a092-16c9427f9b0a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7df5830a-788c-4454-8d89-cd6c57ab1209", "device": "/dev/sdb"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:25:44.416175 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b5e994fe-4a07-451c-a092-16c9427f9b0a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:44.434817 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5e994fe-4a07-451c-a092-16c9427f9b0a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:44.437367 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5e994fe-4a07-451c-a092-16c9427f9b0a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:44.439546 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5e994fe-4a07-451c-a092-16c9427f9b0a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:44.440574 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5e994fe-4a07-451c-a092-16c9427f9b0a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:44.441265 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5e994fe-4a07-451c-a092-16c9427f9b0a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:44.441856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5e994fe-4a07-451c-a092-16c9427f9b0a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:44.452708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8271cffb-201c-4e8a-8a93-5b45fabb9ae1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:44.476870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8271cffb-201c-4e8a-8a93-5b45fabb9ae1 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1701 microversion: 2.1 time: 0.655522 Aug 19 15:25:44.479488 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 177/340] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:43 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1701 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:44.504623 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7d65b4fd-96c2-425e-87cb-afc30f6a8c7b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:25:44.514049 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d65b4fd-96c2-425e-87cb-afc30f6a8c7b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:44.515009 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d65b4fd-96c2-425e-87cb-afc30f6a8c7b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:44.515633 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d65b4fd-96c2-425e-87cb-afc30f6a8c7b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:44.550937 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7d65b4fd-96c2-425e-87cb-afc30f6a8c7b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Going to try to start instance {{(pid=120638) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 19 15:25:44.711166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7d65b4fd-96c2-425e-87cb-afc30f6a8c7b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "POST /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d/action" status: 202 len: 0 microversion: 2.1 time: 0.204850 Aug 19 15:25:44.713315 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 178/341] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Aug 19 15:25:44 2022] POST /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 19 15:25:44.727518 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-45dde5b2-bf2b-4d18-8c5e-b629b4f36bb5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:44.731029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-45dde5b2-bf2b-4d18-8c5e-b629b4f36bb5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:44.743161 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45dde5b2-bf2b-4d18-8c5e-b629b4f36bb5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:44.743892 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45dde5b2-bf2b-4d18-8c5e-b629b4f36bb5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:44.744684 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45dde5b2-bf2b-4d18-8c5e-b629b4f36bb5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:44.747738 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45dde5b2-bf2b-4d18-8c5e-b629b4f36bb5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:44.748742 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45dde5b2-bf2b-4d18-8c5e-b629b4f36bb5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:44.749648 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45dde5b2-bf2b-4d18-8c5e-b629b4f36bb5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:45.156064 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b5e994fe-4a07-451c-a092-16c9427f9b0a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "POST /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.770751 Aug 19 15:25:45.157862 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 164/342] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Aug 19 15:25:44 2022] POST /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb/os-volume_attachments => generated 194 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:25:45.190825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-804e61ff-903e-41fc-a1af-f73ca1f651de tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:45.193030 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-804e61ff-903e-41fc-a1af-f73ca1f651de tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:45.222810 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-804e61ff-903e-41fc-a1af-f73ca1f651de tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:45.223679 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-804e61ff-903e-41fc-a1af-f73ca1f651de tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:45.224715 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-804e61ff-903e-41fc-a1af-f73ca1f651de tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:45.227575 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-804e61ff-903e-41fc-a1af-f73ca1f651de tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:45.228137 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-804e61ff-903e-41fc-a1af-f73ca1f651de tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:45.228854 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-804e61ff-903e-41fc-a1af-f73ca1f651de tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:45.557000 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-45dde5b2-bf2b-4d18-8c5e-b629b4f36bb5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:45.571278 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-45dde5b2-bf2b-4d18-8c5e-b629b4f36bb5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1710 microversion: 2.1 time: 0.850962 Aug 19 15:25:45.577724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 179/343] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:44 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1710 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:45.588293 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-edfb69d3-386d-4314-948e-85d0c827ceb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:45.588293 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-edfb69d3-386d-4314-948e-85d0c827ceb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:45.607633 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edfb69d3-386d-4314-948e-85d0c827ceb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:45.609396 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edfb69d3-386d-4314-948e-85d0c827ceb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:45.611208 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-804e61ff-903e-41fc-a1af-f73ca1f651de tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:45.612146 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edfb69d3-386d-4314-948e-85d0c827ceb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:45.616590 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edfb69d3-386d-4314-948e-85d0c827ceb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:45.621950 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edfb69d3-386d-4314-948e-85d0c827ceb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:45.625303 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edfb69d3-386d-4314-948e-85d0c827ceb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:45.626357 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-804e61ff-903e-41fc-a1af-f73ca1f651de tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1299 microversion: 2.1 time: 0.467044 Aug 19 15:25:45.627316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 165/344] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:45 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1299 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:45.687438 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:45.843077 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-edfb69d3-386d-4314-948e-85d0c827ceb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:45.861853 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-edfb69d3-386d-4314-948e-85d0c827ceb2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1303 microversion: 2.1 time: 0.281844 Aug 19 15:25:45.863635 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 180/345] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:45 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1303 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:46.615502 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2b9ee3c7-6d05-4076-8003-7fbd04651445 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:46.617609 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2b9ee3c7-6d05-4076-8003-7fbd04651445 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:46.627783 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b9ee3c7-6d05-4076-8003-7fbd04651445 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:46.628645 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b9ee3c7-6d05-4076-8003-7fbd04651445 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:46.629351 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b9ee3c7-6d05-4076-8003-7fbd04651445 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:46.633057 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b9ee3c7-6d05-4076-8003-7fbd04651445 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:46.635166 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b9ee3c7-6d05-4076-8003-7fbd04651445 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:46.640078 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b9ee3c7-6d05-4076-8003-7fbd04651445 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:46.659313 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c5ba081a-25d7-475e-88d5-59401e5a5d89 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:46.660983 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c5ba081a-25d7-475e-88d5-59401e5a5d89 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:46.698796 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5ba081a-25d7-475e-88d5-59401e5a5d89 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:46.700063 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5ba081a-25d7-475e-88d5-59401e5a5d89 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:46.700902 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5ba081a-25d7-475e-88d5-59401e5a5d89 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:46.701947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5ba081a-25d7-475e-88d5-59401e5a5d89 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:46.702612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5ba081a-25d7-475e-88d5-59401e5a5d89 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:46.703286 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5ba081a-25d7-475e-88d5-59401e5a5d89 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:46.869102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c5ba081a-25d7-475e-88d5-59401e5a5d89 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:46.890566 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c5ba081a-25d7-475e-88d5-59401e5a5d89 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1299 microversion: 2.1 time: 0.237857 Aug 19 15:25:46.898445 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 181/346] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:46 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1299 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:46.911711 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-db33af82-1e13-4c07-9805-e0d70ad00516 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:46.919772 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-db33af82-1e13-4c07-9805-e0d70ad00516 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:46.940646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db33af82-1e13-4c07-9805-e0d70ad00516 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:46.943648 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db33af82-1e13-4c07-9805-e0d70ad00516 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:46.944097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db33af82-1e13-4c07-9805-e0d70ad00516 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:46.949693 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db33af82-1e13-4c07-9805-e0d70ad00516 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:46.950306 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db33af82-1e13-4c07-9805-e0d70ad00516 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:46.951990 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db33af82-1e13-4c07-9805-e0d70ad00516 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:47.128417 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-db33af82-1e13-4c07-9805-e0d70ad00516 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:47.143635 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-db33af82-1e13-4c07-9805-e0d70ad00516 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1303 microversion: 2.1 time: 0.243460 Aug 19 15:25:47.149642 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 182/347] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:46 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1303 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:47.223010 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b9ee3c7-6d05-4076-8003-7fbd04651445 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:47.237740 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2b9ee3c7-6d05-4076-8003-7fbd04651445 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1710 microversion: 2.1 time: 0.629817 Aug 19 15:25:47.239949 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 166/348] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:46 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1710 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:47.914387 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7d3c5251-1b55-4640-9e20-e14a99e3ef56 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:47.914992 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7d3c5251-1b55-4640-9e20-e14a99e3ef56 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:47.925610 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d3c5251-1b55-4640-9e20-e14a99e3ef56 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:47.926522 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d3c5251-1b55-4640-9e20-e14a99e3ef56 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:47.927224 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d3c5251-1b55-4640-9e20-e14a99e3ef56 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:47.928708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d3c5251-1b55-4640-9e20-e14a99e3ef56 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:47.929923 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d3c5251-1b55-4640-9e20-e14a99e3ef56 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:47.930668 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d3c5251-1b55-4640-9e20-e14a99e3ef56 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:48.172208 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4e4f83e4-20e7-458a-a864-9a69bd480dee tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:48.172924 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4e4f83e4-20e7-458a-a864-9a69bd480dee tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:48.188414 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e4f83e4-20e7-458a-a864-9a69bd480dee tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:48.190151 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e4f83e4-20e7-458a-a864-9a69bd480dee tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:48.191741 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e4f83e4-20e7-458a-a864-9a69bd480dee tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:48.194102 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e4f83e4-20e7-458a-a864-9a69bd480dee tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:48.194791 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e4f83e4-20e7-458a-a864-9a69bd480dee tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:48.196739 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e4f83e4-20e7-458a-a864-9a69bd480dee tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:48.305974 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7d3c5251-1b55-4640-9e20-e14a99e3ef56 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:48.325050 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7d3c5251-1b55-4640-9e20-e14a99e3ef56 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.414201 Aug 19 15:25:48.325714 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 183/349] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:47 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:48.342267 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c95edc2e-6e6a-4d62-9dc9-4dbc82cdac3e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:48.356052 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c95edc2e-6e6a-4d62-9dc9-4dbc82cdac3e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:48.383485 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c95edc2e-6e6a-4d62-9dc9-4dbc82cdac3e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:48.388868 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c95edc2e-6e6a-4d62-9dc9-4dbc82cdac3e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:48.390744 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c95edc2e-6e6a-4d62-9dc9-4dbc82cdac3e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:48.397388 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c95edc2e-6e6a-4d62-9dc9-4dbc82cdac3e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:48.400449 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c95edc2e-6e6a-4d62-9dc9-4dbc82cdac3e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:48.402059 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c95edc2e-6e6a-4d62-9dc9-4dbc82cdac3e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:48.456420 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4e4f83e4-20e7-458a-a864-9a69bd480dee tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:48.473555 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4e4f83e4-20e7-458a-a864-9a69bd480dee tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1303 microversion: 2.1 time: 0.305756 Aug 19 15:25:48.486946 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 167/350] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:48 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1303 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:48.820559 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c95edc2e-6e6a-4d62-9dc9-4dbc82cdac3e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:48.850281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c95edc2e-6e6a-4d62-9dc9-4dbc82cdac3e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1710 microversion: 2.1 time: 0.516952 Aug 19 15:25:48.850879 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 184/351] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:48 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1710 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:49.359830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8ede1bae-89ed-4896-b002-a5470a2d6177 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:49.361346 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8ede1bae-89ed-4896-b002-a5470a2d6177 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:49.377682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ede1bae-89ed-4896-b002-a5470a2d6177 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:49.378858 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ede1bae-89ed-4896-b002-a5470a2d6177 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:49.382570 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ede1bae-89ed-4896-b002-a5470a2d6177 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:49.384471 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ede1bae-89ed-4896-b002-a5470a2d6177 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:49.390314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ede1bae-89ed-4896-b002-a5470a2d6177 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:49.393463 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ede1bae-89ed-4896-b002-a5470a2d6177 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:49.500229 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-65288e94-7dff-450f-8b31-09a4eeace453 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:49.501108 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-65288e94-7dff-450f-8b31-09a4eeace453 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:49.520086 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65288e94-7dff-450f-8b31-09a4eeace453 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:49.520653 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65288e94-7dff-450f-8b31-09a4eeace453 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:49.521104 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65288e94-7dff-450f-8b31-09a4eeace453 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:49.524799 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65288e94-7dff-450f-8b31-09a4eeace453 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:49.528316 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65288e94-7dff-450f-8b31-09a4eeace453 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:49.528805 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65288e94-7dff-450f-8b31-09a4eeace453 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:50.316791 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8ede1bae-89ed-4896-b002-a5470a2d6177 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:50.328313 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8ede1bae-89ed-4896-b002-a5470a2d6177 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.981596 Aug 19 15:25:50.332585 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 168/352] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:49 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:50.341897 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1319c72f-7c54-456d-a8ff-be806b63989b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:50.342813 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1319c72f-7c54-456d-a8ff-be806b63989b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:50.363248 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1319c72f-7c54-456d-a8ff-be806b63989b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:50.364574 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1319c72f-7c54-456d-a8ff-be806b63989b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:50.365253 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1319c72f-7c54-456d-a8ff-be806b63989b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:50.366148 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1319c72f-7c54-456d-a8ff-be806b63989b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:50.366760 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1319c72f-7c54-456d-a8ff-be806b63989b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:50.367341 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1319c72f-7c54-456d-a8ff-be806b63989b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:50.391079 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-65288e94-7dff-450f-8b31-09a4eeace453 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:50.414973 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-65288e94-7dff-450f-8b31-09a4eeace453 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1371 microversion: 2.1 time: 0.919427 Aug 19 15:25:50.433460 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 185/353] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:49 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1371 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:50.655725 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:50.774351 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1319c72f-7c54-456d-a8ff-be806b63989b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:50.790879 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1319c72f-7c54-456d-a8ff-be806b63989b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1710 microversion: 2.1 time: 0.454801 Aug 19 15:25:50.792189 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 169/354] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:50 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1710 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:51.327787 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:51.329529 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=16 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:51.333654 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-fa8aa10e-7aa2-4f6a-8542-18d7509b2926 req-adebf717-1344-4806-b5fd-1a2637b3d3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4717c9f-2cd2-419b-a91c-7f722d99dd27", "tag": "789e4df0-1af5-4f96-9194-ab12ac1b5047"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:25:51.359222 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aff03ffc-4d1f-4fbf-ae33-96d4260fe7ea tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:51.360180 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aff03ffc-4d1f-4fbf-ae33-96d4260fe7ea tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:51.367840 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=8 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:51.370559 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aff03ffc-4d1f-4fbf-ae33-96d4260fe7ea tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:51.376515 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aff03ffc-4d1f-4fbf-ae33-96d4260fe7ea tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:51.377105 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aff03ffc-4d1f-4fbf-ae33-96d4260fe7ea tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:51.378170 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aff03ffc-4d1f-4fbf-ae33-96d4260fe7ea tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:51.378797 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aff03ffc-4d1f-4fbf-ae33-96d4260fe7ea tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:51.379462 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aff03ffc-4d1f-4fbf-ae33-96d4260fe7ea tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:51.385483 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-fa8aa10e-7aa2-4f6a-8542-18d7509b2926 req-adebf717-1344-4806-b5fd-1a2637b3d3e4 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:51.390250 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-fa8aa10e-7aa2-4f6a-8542-18d7509b2926 req-adebf717-1344-4806-b5fd-1a2637b3d3e4 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:51.390856 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-fa8aa10e-7aa2-4f6a-8542-18d7509b2926 req-adebf717-1344-4806-b5fd-1a2637b3d3e4 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:51.432997 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-fa8aa10e-7aa2-4f6a-8542-18d7509b2926 req-adebf717-1344-4806-b5fd-1a2637b3d3e4 service nova] Creating event network-changed:789e4df0-1af5-4f96-9194-ab12ac1b5047 for instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 on hv-cinder-83538 Aug 19 15:25:51.460978 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-fa8aa10e-7aa2-4f6a-8542-18d7509b2926 req-adebf717-1344-4806-b5fd-1a2637b3d3e4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131775 Aug 19 15:25:51.463277 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 186/355] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:25:51.478054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b43bdc99-a1d5-444d-9b80-f9a56363bf79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:51.483994 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b43bdc99-a1d5-444d-9b80-f9a56363bf79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:51.507148 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b43bdc99-a1d5-444d-9b80-f9a56363bf79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:51.508032 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b43bdc99-a1d5-444d-9b80-f9a56363bf79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:51.508656 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b43bdc99-a1d5-444d-9b80-f9a56363bf79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:51.509603 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b43bdc99-a1d5-444d-9b80-f9a56363bf79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:51.510206 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b43bdc99-a1d5-444d-9b80-f9a56363bf79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:51.511443 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b43bdc99-a1d5-444d-9b80-f9a56363bf79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:51.751296 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-aff03ffc-4d1f-4fbf-ae33-96d4260fe7ea tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:51.768630 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aff03ffc-4d1f-4fbf-ae33-96d4260fe7ea tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.410160 Aug 19 15:25:51.769262 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 170/356] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:51 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:51.818259 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1f310ac4-d924-40e4-a8fd-279618c66f0f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:51.820102 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1f310ac4-d924-40e4-a8fd-279618c66f0f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:51.831805 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f310ac4-d924-40e4-a8fd-279618c66f0f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:51.834563 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f310ac4-d924-40e4-a8fd-279618c66f0f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:51.836938 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f310ac4-d924-40e4-a8fd-279618c66f0f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:51.837858 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f310ac4-d924-40e4-a8fd-279618c66f0f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:51.839803 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f310ac4-d924-40e4-a8fd-279618c66f0f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:51.840460 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f310ac4-d924-40e4-a8fd-279618c66f0f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:51.899158 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b43bdc99-a1d5-444d-9b80-f9a56363bf79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:51.908972 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b43bdc99-a1d5-444d-9b80-f9a56363bf79 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1371 microversion: 2.1 time: 0.442208 Aug 19 15:25:51.927857 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 187/357] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:51 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1371 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:52.221769 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1f310ac4-d924-40e4-a8fd-279618c66f0f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:52.231331 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1f310ac4-d924-40e4-a8fd-279618c66f0f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1710 microversion: 2.1 time: 0.417650 Aug 19 15:25:52.235574 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 171/358] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:51 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1710 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:52.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-06f60ea1-2a12-460b-8e12-42749192db9f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:52.794933 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-06f60ea1-2a12-460b-8e12-42749192db9f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:52.803954 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06f60ea1-2a12-460b-8e12-42749192db9f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:52.804740 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06f60ea1-2a12-460b-8e12-42749192db9f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:52.805330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06f60ea1-2a12-460b-8e12-42749192db9f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:52.806228 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06f60ea1-2a12-460b-8e12-42749192db9f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:52.806870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06f60ea1-2a12-460b-8e12-42749192db9f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:52.808003 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06f60ea1-2a12-460b-8e12-42749192db9f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:52.955645 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7d5edc35-8b05-46d8-ada1-bbc207d15593 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:52.956442 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7d5edc35-8b05-46d8-ada1-bbc207d15593 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:52.983621 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d5edc35-8b05-46d8-ada1-bbc207d15593 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:52.984125 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d5edc35-8b05-46d8-ada1-bbc207d15593 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:52.984599 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d5edc35-8b05-46d8-ada1-bbc207d15593 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:52.988709 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d5edc35-8b05-46d8-ada1-bbc207d15593 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:52.989823 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d5edc35-8b05-46d8-ada1-bbc207d15593 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:52.990265 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d5edc35-8b05-46d8-ada1-bbc207d15593 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:53.377768 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-06f60ea1-2a12-460b-8e12-42749192db9f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:53.389820 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-06f60ea1-2a12-460b-8e12-42749192db9f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.601471 Aug 19 15:25:53.404426 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 188/359] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:52 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:53.413043 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9cb120f0-f36e-4458-8143-e1e1fba14bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:53.413859 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9cb120f0-f36e-4458-8143-e1e1fba14bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:53.469998 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cb120f0-f36e-4458-8143-e1e1fba14bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:53.470557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cb120f0-f36e-4458-8143-e1e1fba14bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:53.470912 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cb120f0-f36e-4458-8143-e1e1fba14bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:53.471629 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cb120f0-f36e-4458-8143-e1e1fba14bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:53.472081 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cb120f0-f36e-4458-8143-e1e1fba14bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:53.481614 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cb120f0-f36e-4458-8143-e1e1fba14bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:53.499395 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7d5edc35-8b05-46d8-ada1-bbc207d15593 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:53.522897 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7d5edc35-8b05-46d8-ada1-bbc207d15593 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1371 microversion: 2.1 time: 0.590022 Aug 19 15:25:53.552935 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 172/360] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:52 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1371 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:53.560072 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-d10df754-fb3b-4eaa-a319-838835ab4114 req-5cfc5421-83f9-4081-ac47-bba17ed3cd40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73df7a2-f347-4f80-8853-f5ea25b0cbc7", "tag": "ca54f86e-c00b-4076-ac42-4e78405cb1a7"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:25:53.588254 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-d10df754-fb3b-4eaa-a319-838835ab4114 req-5cfc5421-83f9-4081-ac47-bba17ed3cd40 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:53.589268 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-d10df754-fb3b-4eaa-a319-838835ab4114 req-5cfc5421-83f9-4081-ac47-bba17ed3cd40 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:53.589946 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-d10df754-fb3b-4eaa-a319-838835ab4114 req-5cfc5421-83f9-4081-ac47-bba17ed3cd40 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:53.630324 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-d10df754-fb3b-4eaa-a319-838835ab4114 req-5cfc5421-83f9-4081-ac47-bba17ed3cd40 service nova] Creating event network-changed:ca54f86e-c00b-4076-ac42-4e78405cb1a7 for instance c73df7a2-f347-4f80-8853-f5ea25b0cbc7 on hv-cinder-83538 Aug 19 15:25:53.649495 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-d10df754-fb3b-4eaa-a319-838835ab4114 req-5cfc5421-83f9-4081-ac47-bba17ed3cd40 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094316 Aug 19 15:25:53.651422 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 173/361] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:25:53.789430 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9cb120f0-f36e-4458-8143-e1e1fba14bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:53.798602 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9cb120f0-f36e-4458-8143-e1e1fba14bd0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1714 microversion: 2.1 time: 0.402128 Aug 19 15:25:53.799349 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 189/362] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:53 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1714 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:54.444593 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b253e661-9dea-4702-86f4-cdcf955c0a0c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:54.446703 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b253e661-9dea-4702-86f4-cdcf955c0a0c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:54.459475 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b253e661-9dea-4702-86f4-cdcf955c0a0c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:54.459983 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b253e661-9dea-4702-86f4-cdcf955c0a0c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:54.460718 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b253e661-9dea-4702-86f4-cdcf955c0a0c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:54.463033 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b253e661-9dea-4702-86f4-cdcf955c0a0c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:54.463505 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b253e661-9dea-4702-86f4-cdcf955c0a0c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:54.464173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b253e661-9dea-4702-86f4-cdcf955c0a0c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:54.544903 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-824b9971-0ea6-44db-a1c4-2b9fe919b449 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:54.545513 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-824b9971-0ea6-44db-a1c4-2b9fe919b449 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:54.565926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-824b9971-0ea6-44db-a1c4-2b9fe919b449 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:54.566781 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-824b9971-0ea6-44db-a1c4-2b9fe919b449 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:54.578530 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-824b9971-0ea6-44db-a1c4-2b9fe919b449 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:54.580309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-824b9971-0ea6-44db-a1c4-2b9fe919b449 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:54.580851 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-824b9971-0ea6-44db-a1c4-2b9fe919b449 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:54.581290 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-824b9971-0ea6-44db-a1c4-2b9fe919b449 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:54.921359 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-824b9971-0ea6-44db-a1c4-2b9fe919b449 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:54.936779 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b253e661-9dea-4702-86f4-cdcf955c0a0c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:54.950048 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-824b9971-0ea6-44db-a1c4-2b9fe919b449 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1371 microversion: 2.1 time: 0.410326 Aug 19 15:25:54.952667 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b253e661-9dea-4702-86f4-cdcf955c0a0c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.532568 Aug 19 15:25:54.970073 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 190/363] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:54 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1371 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:54.972006 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 174/364] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:54 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:55.984921 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-888e8e9f-68a1-4bf5-8e86-7d1b7751b7bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:55.986121 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-888e8e9f-68a1-4bf5-8e86-7d1b7751b7bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:56.000823 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ccdc2db0-3745-43aa-a25b-fcdc8c73e106 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:56.004800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ccdc2db0-3745-43aa-a25b-fcdc8c73e106 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:56.036532 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-888e8e9f-68a1-4bf5-8e86-7d1b7751b7bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:56.037547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-888e8e9f-68a1-4bf5-8e86-7d1b7751b7bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:56.039872 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ccdc2db0-3745-43aa-a25b-fcdc8c73e106 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:56.040769 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ccdc2db0-3745-43aa-a25b-fcdc8c73e106 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:56.042468 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-888e8e9f-68a1-4bf5-8e86-7d1b7751b7bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:56.043894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-888e8e9f-68a1-4bf5-8e86-7d1b7751b7bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:56.044443 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ccdc2db0-3745-43aa-a25b-fcdc8c73e106 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:56.045276 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ccdc2db0-3745-43aa-a25b-fcdc8c73e106 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:56.046828 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-888e8e9f-68a1-4bf5-8e86-7d1b7751b7bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:56.053459 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-888e8e9f-68a1-4bf5-8e86-7d1b7751b7bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:56.053923 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ccdc2db0-3745-43aa-a25b-fcdc8c73e106 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:56.058988 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ccdc2db0-3745-43aa-a25b-fcdc8c73e106 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:56.411993 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ccdc2db0-3745-43aa-a25b-fcdc8c73e106 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:56.422913 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ccdc2db0-3745-43aa-a25b-fcdc8c73e106 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.428824 Aug 19 15:25:56.430893 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 175/365] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:55 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:56.438257 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-888e8e9f-68a1-4bf5-8e86-7d1b7751b7bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:56.454160 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-888e8e9f-68a1-4bf5-8e86-7d1b7751b7bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1371 microversion: 2.1 time: 0.477406 Aug 19 15:25:56.456260 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 191/366] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:55 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1371 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:57.454262 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f57384a7-e9bb-4b8f-9e7a-7600685cfc11 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:57.455828 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f57384a7-e9bb-4b8f-9e7a-7600685cfc11 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:57.465328 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f57384a7-e9bb-4b8f-9e7a-7600685cfc11 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:57.466734 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f57384a7-e9bb-4b8f-9e7a-7600685cfc11 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:57.467568 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f57384a7-e9bb-4b8f-9e7a-7600685cfc11 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:57.468901 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f57384a7-e9bb-4b8f-9e7a-7600685cfc11 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:57.469847 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f57384a7-e9bb-4b8f-9e7a-7600685cfc11 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:57.470589 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f57384a7-e9bb-4b8f-9e7a-7600685cfc11 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:57.675400 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f57384a7-e9bb-4b8f-9e7a-7600685cfc11 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:57.686193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f57384a7-e9bb-4b8f-9e7a-7600685cfc11 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.238419 Aug 19 15:25:57.687172 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 192/367] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:57 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:25:57.692169 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cddc8500-5d01-4e74-b8b4-9fddfdd42085 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:57.693126 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cddc8500-5d01-4e74-b8b4-9fddfdd42085 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:57.701714 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cddc8500-5d01-4e74-b8b4-9fddfdd42085 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:57.702473 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cddc8500-5d01-4e74-b8b4-9fddfdd42085 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:57.703144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cddc8500-5d01-4e74-b8b4-9fddfdd42085 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:57.704082 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cddc8500-5d01-4e74-b8b4-9fddfdd42085 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:57.704816 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cddc8500-5d01-4e74-b8b4-9fddfdd42085 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:57.705466 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cddc8500-5d01-4e74-b8b4-9fddfdd42085 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:57.757199 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ab6e389-2c5a-41dd-893a-5bb7227a6d27 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Action: 'create', calling method: .version_select at 0x7fb5334fb8b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1301407205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnQuxGGkC1GFRQulti238AJDL9CccAJJAB0H7YZKIXEQJefGTkBzC/5BoAK+O5x3kqladA0sE3/kHphjOZZusE6qYnA05aFJG70aRJdccy1uBkXrgiY1dNHujwhSbz7EQ=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:25:57.802171 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-2ab6e389-2c5a-41dd-893a-5bb7227a6d27 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Getting quotas for project 0add00db6668475093f558e9700333d1. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:25:57.822241 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-2ab6e389-2c5a-41dd-893a-5bb7227a6d27 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Getting quotas for user af3e7eea0b2840b79404b370382ab44a and project 0add00db6668475093f558e9700333d1. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:25:57.881509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ab6e389-2c5a-41dd-893a-5bb7227a6d27 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.531832 Aug 19 15:25:57.884358 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 176/368] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Aug 19 15:25:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:25:57.972693 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cddc8500-5d01-4e74-b8b4-9fddfdd42085 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:57.985613 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cddc8500-5d01-4e74-b8b4-9fddfdd42085 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1371 microversion: 2.1 time: 0.296759 Aug 19 15:25:58.000255 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 193/369] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:57 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1371 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:58.730701 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d6bb1c4c-f606-4583-be5f-57b2dc7e9301 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:58.733755 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d6bb1c4c-f606-4583-be5f-57b2dc7e9301 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:58.771192 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6bb1c4c-f606-4583-be5f-57b2dc7e9301 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:58.774746 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6bb1c4c-f606-4583-be5f-57b2dc7e9301 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:58.776596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6bb1c4c-f606-4583-be5f-57b2dc7e9301 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:58.778380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6bb1c4c-f606-4583-be5f-57b2dc7e9301 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:58.779769 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6bb1c4c-f606-4583-be5f-57b2dc7e9301 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:58.781780 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6bb1c4c-f606-4583-be5f-57b2dc7e9301 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:58.827802 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:59.019011 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-97d68f1d-3d32-49ae-b80c-c20e047ca2bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:25:59.021959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-97d68f1d-3d32-49ae-b80c-c20e047ca2bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:25:59.039521 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97d68f1d-3d32-49ae-b80c-c20e047ca2bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:59.041013 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97d68f1d-3d32-49ae-b80c-c20e047ca2bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:59.042633 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97d68f1d-3d32-49ae-b80c-c20e047ca2bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:59.044599 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97d68f1d-3d32-49ae-b80c-c20e047ca2bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:25:59.045884 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97d68f1d-3d32-49ae-b80c-c20e047ca2bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:25:59.047016 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97d68f1d-3d32-49ae-b80c-c20e047ca2bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:25:59.078403 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d6bb1c4c-f606-4583-be5f-57b2dc7e9301 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:59.092923 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d6bb1c4c-f606-4583-be5f-57b2dc7e9301 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.375247 Aug 19 15:25:59.093517 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 177/370] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:58 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:25:59.386813 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-97d68f1d-3d32-49ae-b80c-c20e047ca2bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:25:59.399732 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-97d68f1d-3d32-49ae-b80c-c20e047ca2bb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1371 microversion: 2.1 time: 0.394305 Aug 19 15:25:59.404726 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 194/371] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:25:59 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1371 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:00.124349 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-656ee4dd-11c1-4d69-884e-718edf97b64c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:00.124993 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-656ee4dd-11c1-4d69-884e-718edf97b64c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:00.160260 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-656ee4dd-11c1-4d69-884e-718edf97b64c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:00.160823 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-656ee4dd-11c1-4d69-884e-718edf97b64c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:00.161273 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-656ee4dd-11c1-4d69-884e-718edf97b64c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:00.162016 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-656ee4dd-11c1-4d69-884e-718edf97b64c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:00.171857 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-656ee4dd-11c1-4d69-884e-718edf97b64c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:00.172326 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-656ee4dd-11c1-4d69-884e-718edf97b64c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:00.428221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aefe787f-784b-46f1-bbb1-d0200551cc48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:00.429292 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aefe787f-784b-46f1-bbb1-d0200551cc48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:00.451556 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aefe787f-784b-46f1-bbb1-d0200551cc48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:00.452152 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aefe787f-784b-46f1-bbb1-d0200551cc48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:00.455127 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aefe787f-784b-46f1-bbb1-d0200551cc48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:00.456366 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aefe787f-784b-46f1-bbb1-d0200551cc48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:00.456950 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aefe787f-784b-46f1-bbb1-d0200551cc48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:00.467676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aefe787f-784b-46f1-bbb1-d0200551cc48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:00.816870 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-656ee4dd-11c1-4d69-884e-718edf97b64c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:00.826525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-656ee4dd-11c1-4d69-884e-718edf97b64c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.712785 Aug 19 15:26:00.845299 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 178/372] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:00 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:00.968966 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-aefe787f-784b-46f1-bbb1-d0200551cc48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:00.994466 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aefe787f-784b-46f1-bbb1-d0200551cc48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1371 microversion: 2.1 time: 0.569685 Aug 19 15:26:00.999253 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 195/373] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:00 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1371 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:01.866084 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-25c8fde5-be74-4f84-9952-c803e957ba82 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:01.868694 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-25c8fde5-be74-4f84-9952-c803e957ba82 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:01.880526 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25c8fde5-be74-4f84-9952-c803e957ba82 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:01.883368 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25c8fde5-be74-4f84-9952-c803e957ba82 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:01.883821 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25c8fde5-be74-4f84-9952-c803e957ba82 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:01.885228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25c8fde5-be74-4f84-9952-c803e957ba82 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:01.890113 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25c8fde5-be74-4f84-9952-c803e957ba82 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:01.890601 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25c8fde5-be74-4f84-9952-c803e957ba82 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:02.018653 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-afa3edca-7274-4ece-92e4-566ea82aa6e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:02.019858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-afa3edca-7274-4ece-92e4-566ea82aa6e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:02.031957 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afa3edca-7274-4ece-92e4-566ea82aa6e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:02.033244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afa3edca-7274-4ece-92e4-566ea82aa6e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:02.033863 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afa3edca-7274-4ece-92e4-566ea82aa6e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:02.035457 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afa3edca-7274-4ece-92e4-566ea82aa6e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:02.036081 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afa3edca-7274-4ece-92e4-566ea82aa6e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:02.036707 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afa3edca-7274-4ece-92e4-566ea82aa6e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:02.210642 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-25c8fde5-be74-4f84-9952-c803e957ba82 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:02.235897 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-25c8fde5-be74-4f84-9952-c803e957ba82 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.377438 Aug 19 15:26:02.236592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 179/374] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:01 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:02.328576 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-afa3edca-7274-4ece-92e4-566ea82aa6e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:02.343957 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-afa3edca-7274-4ece-92e4-566ea82aa6e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1371 microversion: 2.1 time: 0.327501 Aug 19 15:26:02.347001 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 196/375] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:02 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:26:03.310973 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a6bbdbdc-e5e4-4449-90ce-2701d3499527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:03.311635 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a6bbdbdc-e5e4-4449-90ce-2701d3499527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:03.318564 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6bbdbdc-e5e4-4449-90ce-2701d3499527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:03.319049 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6bbdbdc-e5e4-4449-90ce-2701d3499527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:03.319473 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6bbdbdc-e5e4-4449-90ce-2701d3499527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:03.320169 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6bbdbdc-e5e4-4449-90ce-2701d3499527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:03.320650 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6bbdbdc-e5e4-4449-90ce-2701d3499527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:03.321065 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6bbdbdc-e5e4-4449-90ce-2701d3499527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:03.376934 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3b06fba7-fb05-47e2-af73-e29e37b45c35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:03.378238 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3b06fba7-fb05-47e2-af73-e29e37b45c35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:03.391230 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b06fba7-fb05-47e2-af73-e29e37b45c35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:03.391230 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b06fba7-fb05-47e2-af73-e29e37b45c35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:03.391230 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b06fba7-fb05-47e2-af73-e29e37b45c35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:03.391230 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b06fba7-fb05-47e2-af73-e29e37b45c35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:03.392357 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b06fba7-fb05-47e2-af73-e29e37b45c35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:03.392357 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b06fba7-fb05-47e2-af73-e29e37b45c35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:03.523086 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a6bbdbdc-e5e4-4449-90ce-2701d3499527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:03.532791 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a6bbdbdc-e5e4-4449-90ce-2701d3499527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.225303 Aug 19 15:26:03.533842 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 180/376] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:03 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:03.608579 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3b06fba7-fb05-47e2-af73-e29e37b45c35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:03.612090 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:26:03.618011 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3b06fba7-fb05-47e2-af73-e29e37b45c35 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1371 microversion: 2.1 time: 0.246096 Aug 19 15:26:03.618620 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 197/377] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:03 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:04.555696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d137055a-738c-4cd6-9f30-bd2420a8a12b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:04.557201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d137055a-738c-4cd6-9f30-bd2420a8a12b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:04.570158 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d137055a-738c-4cd6-9f30-bd2420a8a12b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:04.570532 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d137055a-738c-4cd6-9f30-bd2420a8a12b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:04.570961 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d137055a-738c-4cd6-9f30-bd2420a8a12b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:04.571662 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d137055a-738c-4cd6-9f30-bd2420a8a12b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:04.572158 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d137055a-738c-4cd6-9f30-bd2420a8a12b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:04.572543 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d137055a-738c-4cd6-9f30-bd2420a8a12b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:04.642250 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-af29da63-294c-4ba8-811f-659de55527e9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:04.642875 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-af29da63-294c-4ba8-811f-659de55527e9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:04.655610 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af29da63-294c-4ba8-811f-659de55527e9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:04.656109 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af29da63-294c-4ba8-811f-659de55527e9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:04.656572 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af29da63-294c-4ba8-811f-659de55527e9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:04.657537 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af29da63-294c-4ba8-811f-659de55527e9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:04.658214 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af29da63-294c-4ba8-811f-659de55527e9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:04.658877 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af29da63-294c-4ba8-811f-659de55527e9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:04.806041 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d137055a-738c-4cd6-9f30-bd2420a8a12b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:04.819244 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d137055a-738c-4cd6-9f30-bd2420a8a12b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.268330 Aug 19 15:26:04.820997 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 181/378] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:04 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:04.869730 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-af29da63-294c-4ba8-811f-659de55527e9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:04.880180 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-af29da63-294c-4ba8-811f-659de55527e9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1371 microversion: 2.1 time: 0.242139 Aug 19 15:26:04.881110 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 198/379] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:04 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:26:05.846766 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-67c00045-1556-4032-97a6-a53fad09be3c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:05.847385 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-67c00045-1556-4032-97a6-a53fad09be3c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:05.853887 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67c00045-1556-4032-97a6-a53fad09be3c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:05.854578 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67c00045-1556-4032-97a6-a53fad09be3c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:05.855264 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67c00045-1556-4032-97a6-a53fad09be3c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:05.856247 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67c00045-1556-4032-97a6-a53fad09be3c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:05.857047 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67c00045-1556-4032-97a6-a53fad09be3c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:05.857764 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67c00045-1556-4032-97a6-a53fad09be3c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:05.909478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-624a6fce-6543-4960-aae4-478f634573a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:05.910207 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-624a6fce-6543-4960-aae4-478f634573a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:05.919792 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-624a6fce-6543-4960-aae4-478f634573a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:05.920336 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-624a6fce-6543-4960-aae4-478f634573a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:05.921143 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-624a6fce-6543-4960-aae4-478f634573a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:05.922212 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-624a6fce-6543-4960-aae4-478f634573a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:05.922888 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-624a6fce-6543-4960-aae4-478f634573a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:05.923499 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-624a6fce-6543-4960-aae4-478f634573a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:06.084816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-67c00045-1556-4032-97a6-a53fad09be3c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:06.104300 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-67c00045-1556-4032-97a6-a53fad09be3c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.266605 Aug 19 15:26:06.105556 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 182/380] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:05 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:06.126133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-624a6fce-6543-4960-aae4-478f634573a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:06.139047 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-624a6fce-6543-4960-aae4-478f634573a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1371 microversion: 2.1 time: 0.240682 Aug 19 15:26:06.139713 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 199/381] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:05 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:07.139186 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0a28efe3-0797-4f6a-b289-3254827eaf76 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:07.140245 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0a28efe3-0797-4f6a-b289-3254827eaf76 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:07.150112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a28efe3-0797-4f6a-b289-3254827eaf76 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:07.150870 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a28efe3-0797-4f6a-b289-3254827eaf76 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:07.152275 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a28efe3-0797-4f6a-b289-3254827eaf76 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:07.153464 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a28efe3-0797-4f6a-b289-3254827eaf76 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:07.154220 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a28efe3-0797-4f6a-b289-3254827eaf76 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:07.154875 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a28efe3-0797-4f6a-b289-3254827eaf76 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:07.175825 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a4ebec1f-09dd-4e61-bb52-9bacd0f99daf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:07.177796 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a4ebec1f-09dd-4e61-bb52-9bacd0f99daf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:07.189455 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4ebec1f-09dd-4e61-bb52-9bacd0f99daf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:07.192335 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4ebec1f-09dd-4e61-bb52-9bacd0f99daf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:07.193084 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4ebec1f-09dd-4e61-bb52-9bacd0f99daf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:07.194748 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4ebec1f-09dd-4e61-bb52-9bacd0f99daf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:07.196344 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4ebec1f-09dd-4e61-bb52-9bacd0f99daf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:07.197287 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4ebec1f-09dd-4e61-bb52-9bacd0f99daf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:07.430875 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0a28efe3-0797-4f6a-b289-3254827eaf76 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:07.442122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a4ebec1f-09dd-4e61-bb52-9bacd0f99daf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:07.445349 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0a28efe3-0797-4f6a-b289-3254827eaf76 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.313268 Aug 19 15:26:07.446949 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 183/382] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:07 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:07.451848 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a4ebec1f-09dd-4e61-bb52-9bacd0f99daf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1371 microversion: 2.1 time: 0.283242 Aug 19 15:26:07.452604 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 200/383] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:07 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:08.473588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1a526a84-6ade-42a2-b13c-3d42b9c6e920 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:08.475216 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1a526a84-6ade-42a2-b13c-3d42b9c6e920 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:08.481655 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:26:08.484905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a526a84-6ade-42a2-b13c-3d42b9c6e920 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:08.485382 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1e55626a-095c-44e4-806c-174609e528a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:08.485891 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a526a84-6ade-42a2-b13c-3d42b9c6e920 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:08.486130 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a526a84-6ade-42a2-b13c-3d42b9c6e920 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:08.486727 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1e55626a-095c-44e4-806c-174609e528a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:08.486889 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a526a84-6ade-42a2-b13c-3d42b9c6e920 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:08.487470 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a526a84-6ade-42a2-b13c-3d42b9c6e920 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:08.488082 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a526a84-6ade-42a2-b13c-3d42b9c6e920 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:08.494602 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:26:08.498083 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e55626a-095c-44e4-806c-174609e528a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:08.498574 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e55626a-095c-44e4-806c-174609e528a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:08.499306 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e55626a-095c-44e4-806c-174609e528a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:08.500011 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e55626a-095c-44e4-806c-174609e528a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:08.500497 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e55626a-095c-44e4-806c-174609e528a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:08.500908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e55626a-095c-44e4-806c-174609e528a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:08.736089 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1e55626a-095c-44e4-806c-174609e528a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:08.740667 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1a526a84-6ade-42a2-b13c-3d42b9c6e920 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:08.752894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1a526a84-6ade-42a2-b13c-3d42b9c6e920 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1371 microversion: 2.1 time: 0.283220 Aug 19 15:26:08.753115 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1e55626a-095c-44e4-806c-174609e528a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.284970 Aug 19 15:26:08.753685 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 184/384] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:08 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:08.754025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 201/385] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:08 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1371 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:09.129503 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-e3c7e29c-fb38-41cd-a02c-137b4675addb req-e6dc1ede-0c38-4bfa-acb8-8a4223f2af64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73df7a2-f347-4f80-8853-f5ea25b0cbc7", "name": "network-vif-plugged", "status": "completed", "tag": "ca54f86e-c00b-4076-ac42-4e78405cb1a7"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:26:09.142923 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e3c7e29c-fb38-41cd-a02c-137b4675addb req-e6dc1ede-0c38-4bfa-acb8-8a4223f2af64 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:09.143524 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e3c7e29c-fb38-41cd-a02c-137b4675addb req-e6dc1ede-0c38-4bfa-acb8-8a4223f2af64 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:09.144085 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e3c7e29c-fb38-41cd-a02c-137b4675addb req-e6dc1ede-0c38-4bfa-acb8-8a4223f2af64 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:09.158893 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-e3c7e29c-fb38-41cd-a02c-137b4675addb req-e6dc1ede-0c38-4bfa-acb8-8a4223f2af64 service nova] Creating event network-vif-plugged:ca54f86e-c00b-4076-ac42-4e78405cb1a7 for instance c73df7a2-f347-4f80-8853-f5ea25b0cbc7 on hv-cinder-83538 Aug 19 15:26:09.165854 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-e3c7e29c-fb38-41cd-a02c-137b4675addb req-e6dc1ede-0c38-4bfa-acb8-8a4223f2af64 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040293 Aug 19 15:26:09.168226 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 185/386] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:26:09.778976 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f620e448-9c62-4299-90d9-6c02cceb3bf0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:09.779711 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f620e448-9c62-4299-90d9-6c02cceb3bf0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:09.779936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e7dc0f26-f348-408f-88e9-fe765fbaddbb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:09.780842 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e7dc0f26-f348-408f-88e9-fe765fbaddbb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:09.793044 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f620e448-9c62-4299-90d9-6c02cceb3bf0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:09.793569 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f620e448-9c62-4299-90d9-6c02cceb3bf0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:09.798044 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f620e448-9c62-4299-90d9-6c02cceb3bf0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:09.799131 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7dc0f26-f348-408f-88e9-fe765fbaddbb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:09.800096 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7dc0f26-f348-408f-88e9-fe765fbaddbb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:09.801357 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7dc0f26-f348-408f-88e9-fe765fbaddbb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:09.801624 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f620e448-9c62-4299-90d9-6c02cceb3bf0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:09.802081 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f620e448-9c62-4299-90d9-6c02cceb3bf0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:09.803103 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f620e448-9c62-4299-90d9-6c02cceb3bf0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:09.805820 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7dc0f26-f348-408f-88e9-fe765fbaddbb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:09.806689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7dc0f26-f348-408f-88e9-fe765fbaddbb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:09.807843 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7dc0f26-f348-408f-88e9-fe765fbaddbb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:10.073017 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f620e448-9c62-4299-90d9-6c02cceb3bf0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:10.083722 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f620e448-9c62-4299-90d9-6c02cceb3bf0 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.310140 Aug 19 15:26:10.084568 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 186/387] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:09 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:10.129601 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e7dc0f26-f348-408f-88e9-fe765fbaddbb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:10.152104 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e7dc0f26-f348-408f-88e9-fe765fbaddbb tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1371 microversion: 2.1 time: 0.380519 Aug 19 15:26:10.153363 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 202/388] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:09 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1371 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:11.112192 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7a5f48a9-3bef-4e7c-a4fa-45504c25d91d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:11.112900 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7a5f48a9-3bef-4e7c-a4fa-45504c25d91d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:11.127579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a5f48a9-3bef-4e7c-a4fa-45504c25d91d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:11.128347 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a5f48a9-3bef-4e7c-a4fa-45504c25d91d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:11.128875 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a5f48a9-3bef-4e7c-a4fa-45504c25d91d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:11.129672 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a5f48a9-3bef-4e7c-a4fa-45504c25d91d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:11.130473 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a5f48a9-3bef-4e7c-a4fa-45504c25d91d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:11.131203 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a5f48a9-3bef-4e7c-a4fa-45504c25d91d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:11.177349 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f600d2bc-b40a-481b-aa31-11321e793606 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:11.180441 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f600d2bc-b40a-481b-aa31-11321e793606 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:11.191545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f600d2bc-b40a-481b-aa31-11321e793606 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:11.192730 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f600d2bc-b40a-481b-aa31-11321e793606 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:11.220298 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f600d2bc-b40a-481b-aa31-11321e793606 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:11.226014 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f600d2bc-b40a-481b-aa31-11321e793606 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:11.226974 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f600d2bc-b40a-481b-aa31-11321e793606 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:11.229656 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f600d2bc-b40a-481b-aa31-11321e793606 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:11.512974 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7a5f48a9-3bef-4e7c-a4fa-45504c25d91d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:11.521090 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f600d2bc-b40a-481b-aa31-11321e793606 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:11.525795 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7a5f48a9-3bef-4e7c-a4fa-45504c25d91d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.418256 Aug 19 15:26:11.526445 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 187/389] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:11 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:11.531551 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-f2a90d8a-7555-4c9e-ba13-279d45f8f5b1 req-b8e7c98a-550b-4c94-8357-25489548c276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4717c9f-2cd2-419b-a91c-7f722d99dd27", "name": "network-vif-plugged", "status": "completed", "tag": "789e4df0-1af5-4f96-9194-ab12ac1b5047"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:26:11.547033 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f600d2bc-b40a-481b-aa31-11321e793606 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1565 microversion: 2.1 time: 0.376354 Aug 19 15:26:11.548192 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 203/390] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:11 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1565 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:11.553587 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f2a90d8a-7555-4c9e-ba13-279d45f8f5b1 req-b8e7c98a-550b-4c94-8357-25489548c276 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:11.555081 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f2a90d8a-7555-4c9e-ba13-279d45f8f5b1 req-b8e7c98a-550b-4c94-8357-25489548c276 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:11.556952 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f2a90d8a-7555-4c9e-ba13-279d45f8f5b1 req-b8e7c98a-550b-4c94-8357-25489548c276 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:11.576966 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-da90f9d9-8f10-4711-881d-8bc9108deb46 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:11.577727 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-da90f9d9-8f10-4711-881d-8bc9108deb46 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:11.585087 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da90f9d9-8f10-4711-881d-8bc9108deb46 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:11.586906 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-f2a90d8a-7555-4c9e-ba13-279d45f8f5b1 req-b8e7c98a-550b-4c94-8357-25489548c276 service nova] Creating event network-vif-plugged:789e4df0-1af5-4f96-9194-ab12ac1b5047 for instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 on hv-cinder-83538 Aug 19 15:26:11.589495 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da90f9d9-8f10-4711-881d-8bc9108deb46 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:11.590191 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da90f9d9-8f10-4711-881d-8bc9108deb46 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:11.591982 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da90f9d9-8f10-4711-881d-8bc9108deb46 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:11.594702 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da90f9d9-8f10-4711-881d-8bc9108deb46 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:11.595206 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da90f9d9-8f10-4711-881d-8bc9108deb46 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:11.623431 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-f2a90d8a-7555-4c9e-ba13-279d45f8f5b1 req-b8e7c98a-550b-4c94-8357-25489548c276 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094721 Aug 19 15:26:11.624078 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 188/391] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:26:11.781596 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-da90f9d9-8f10-4711-881d-8bc9108deb46 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.214256 Aug 19 15:26:11.783401 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 204/392] 10.222.0.75 () {58 vars in 1275 bytes} [Fri Aug 19 15:26:11 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-interface => generated 285 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:26:12.551306 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3759049c-b4e1-4526-b878-18dd5faf9527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:12.552832 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3759049c-b4e1-4526-b878-18dd5faf9527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:12.567420 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3759049c-b4e1-4526-b878-18dd5faf9527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:12.567907 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3759049c-b4e1-4526-b878-18dd5faf9527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:12.568547 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3759049c-b4e1-4526-b878-18dd5faf9527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:12.569408 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3759049c-b4e1-4526-b878-18dd5faf9527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:12.570015 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3759049c-b4e1-4526-b878-18dd5faf9527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:12.570716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3759049c-b4e1-4526-b878-18dd5faf9527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:13.040272 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3759049c-b4e1-4526-b878-18dd5faf9527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:13.049730 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3759049c-b4e1-4526-b878-18dd5faf9527 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.504195 Aug 19 15:26:13.050224 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 189/393] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:12 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:13.250169 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-39ef7f8f-6e2a-46ae-bf5b-844df5d988df req-6450ef75-a06f-4c19-a60e-196cf3431126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73df7a2-f347-4f80-8853-f5ea25b0cbc7", "tag": "ca54f86e-c00b-4076-ac42-4e78405cb1a7"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:26:13.261390 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9d196769-b161-47a7-9d5f-a90c56e8fd0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:13.261390 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9d196769-b161-47a7-9d5f-a90c56e8fd0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:13.269438 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d196769-b161-47a7-9d5f-a90c56e8fd0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:13.270082 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d196769-b161-47a7-9d5f-a90c56e8fd0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:13.270513 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d196769-b161-47a7-9d5f-a90c56e8fd0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:13.271206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d196769-b161-47a7-9d5f-a90c56e8fd0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:13.271643 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d196769-b161-47a7-9d5f-a90c56e8fd0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:13.272067 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d196769-b161-47a7-9d5f-a90c56e8fd0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:13.280869 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-39ef7f8f-6e2a-46ae-bf5b-844df5d988df req-6450ef75-a06f-4c19-a60e-196cf3431126 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:13.281343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-39ef7f8f-6e2a-46ae-bf5b-844df5d988df req-6450ef75-a06f-4c19-a60e-196cf3431126 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:13.282023 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-39ef7f8f-6e2a-46ae-bf5b-844df5d988df req-6450ef75-a06f-4c19-a60e-196cf3431126 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:13.301837 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-39ef7f8f-6e2a-46ae-bf5b-844df5d988df req-6450ef75-a06f-4c19-a60e-196cf3431126 service nova] Creating event network-changed:ca54f86e-c00b-4076-ac42-4e78405cb1a7 for instance c73df7a2-f347-4f80-8853-f5ea25b0cbc7 on hv-cinder-83538 Aug 19 15:26:13.306833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-39ef7f8f-6e2a-46ae-bf5b-844df5d988df req-6450ef75-a06f-4c19-a60e-196cf3431126 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065152 Aug 19 15:26:13.308447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 205/394] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:26:13.445854 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-9d196769-b161-47a7-9d5f-a90c56e8fd0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lazy-loading 'services' on Instance uuid e7452037-dcc4-487a-8552-4b6d02b2dabb {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:26:13.590767 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9d196769-b161-47a7-9d5f-a90c56e8fd0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb/os-volume_attachments/7df5830a-788c-4454-8d89-cd6c57ab1209" status: 202 len: 0 microversion: 2.1 time: 0.336749 Aug 19 15:26:13.591491 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 190/395] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Aug 19 15:26:13 2022] DELETE /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb/os-volume_attachments/7df5830a-788c-4454-8d89-cd6c57ab1209 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:26:14.075268 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-593821eb-0d9f-443a-89c9-3c6b5ab31d97 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:14.075966 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-593821eb-0d9f-443a-89c9-3c6b5ab31d97 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:14.083314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-593821eb-0d9f-443a-89c9-3c6b5ab31d97 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:14.083800 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-593821eb-0d9f-443a-89c9-3c6b5ab31d97 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:14.084463 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-593821eb-0d9f-443a-89c9-3c6b5ab31d97 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:14.085480 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-593821eb-0d9f-443a-89c9-3c6b5ab31d97 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:14.085942 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-593821eb-0d9f-443a-89c9-3c6b5ab31d97 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:14.086362 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-593821eb-0d9f-443a-89c9-3c6b5ab31d97 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:14.268845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-593821eb-0d9f-443a-89c9-3c6b5ab31d97 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:14.289620 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-593821eb-0d9f-443a-89c9-3c6b5ab31d97 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1367 microversion: 2.1 time: 0.219165 Aug 19 15:26:14.298958 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 206/396] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:14 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:15.321198 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f9755785-ddc0-4d49-a817-685ad54d8316 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:15.321899 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f9755785-ddc0-4d49-a817-685ad54d8316 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:15.325054 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:26:15.335731 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9755785-ddc0-4d49-a817-685ad54d8316 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:15.335731 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9755785-ddc0-4d49-a817-685ad54d8316 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:15.335731 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9755785-ddc0-4d49-a817-685ad54d8316 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:15.336572 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9755785-ddc0-4d49-a817-685ad54d8316 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:15.337024 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9755785-ddc0-4d49-a817-685ad54d8316 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:15.337455 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9755785-ddc0-4d49-a817-685ad54d8316 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:15.490630 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f9755785-ddc0-4d49-a817-685ad54d8316 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:15.499888 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f9755785-ddc0-4d49-a817-685ad54d8316 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1557 microversion: 2.1 time: 0.184073 Aug 19 15:26:15.500870 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 191/397] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:15 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1557 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:15.529042 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-68fa1bcc-d87a-4094-bdf9-6ff2082a18a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:15.530147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-68fa1bcc-d87a-4094-bdf9-6ff2082a18a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:15.538224 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68fa1bcc-d87a-4094-bdf9-6ff2082a18a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:15.538794 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68fa1bcc-d87a-4094-bdf9-6ff2082a18a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:15.539325 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68fa1bcc-d87a-4094-bdf9-6ff2082a18a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:15.540199 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68fa1bcc-d87a-4094-bdf9-6ff2082a18a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:15.540824 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68fa1bcc-d87a-4094-bdf9-6ff2082a18a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:15.541333 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68fa1bcc-d87a-4094-bdf9-6ff2082a18a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:15.655457 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-68fa1bcc-d87a-4094-bdf9-6ff2082a18a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133955 Aug 19 15:26:15.656052 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 207/398] 10.222.0.75 () {58 vars in 1275 bytes} [Fri Aug 19 15:26:15 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:26:15.831504 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f8bb5c06-5049-4420-ac7d-565d07841070 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:15.832000 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f8bb5c06-5049-4420-ac7d-565d07841070 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:15.838202 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8bb5c06-5049-4420-ac7d-565d07841070 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:15.839293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8bb5c06-5049-4420-ac7d-565d07841070 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:15.839721 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8bb5c06-5049-4420-ac7d-565d07841070 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:15.840706 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8bb5c06-5049-4420-ac7d-565d07841070 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:15.840914 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8bb5c06-5049-4420-ac7d-565d07841070 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:15.841340 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8bb5c06-5049-4420-ac7d-565d07841070 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:15.879316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f8bb5c06-5049-4420-ac7d-565d07841070 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:26:15.969735 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f8bb5c06-5049-4420-ac7d-565d07841070 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 204 len: 0 microversion: 2.1 time: 0.141793 Aug 19 15:26:15.970338 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 192/399] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:26:15 2022] DELETE /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:26:15.980516 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-648484b8-25e0-4f82-b1e6-4ba531fc870f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:15.981196 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-648484b8-25e0-4f82-b1e6-4ba531fc870f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:15.989018 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-648484b8-25e0-4f82-b1e6-4ba531fc870f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:15.989634 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-648484b8-25e0-4f82-b1e6-4ba531fc870f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:15.990176 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-648484b8-25e0-4f82-b1e6-4ba531fc870f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:15.991329 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-648484b8-25e0-4f82-b1e6-4ba531fc870f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:15.991908 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-648484b8-25e0-4f82-b1e6-4ba531fc870f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:15.992437 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-648484b8-25e0-4f82-b1e6-4ba531fc870f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:16.141649 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-648484b8-25e0-4f82-b1e6-4ba531fc870f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:16.165307 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-648484b8-25e0-4f82-b1e6-4ba531fc870f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1514 microversion: 2.1 time: 0.190208 Aug 19 15:26:16.166246 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 208/400] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:15 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:16.829043 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-cd296373-96be-4ef5-a96d-e3945a51355f req-3ef7d88b-cc01-40d8-8c2c-e5ea169aeb64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4717c9f-2cd2-419b-a91c-7f722d99dd27", "tag": "789e4df0-1af5-4f96-9194-ab12ac1b5047"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:26:16.840554 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-cd296373-96be-4ef5-a96d-e3945a51355f req-3ef7d88b-cc01-40d8-8c2c-e5ea169aeb64 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:16.841310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-cd296373-96be-4ef5-a96d-e3945a51355f req-3ef7d88b-cc01-40d8-8c2c-e5ea169aeb64 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:16.841704 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-cd296373-96be-4ef5-a96d-e3945a51355f req-3ef7d88b-cc01-40d8-8c2c-e5ea169aeb64 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:16.852341 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:26:16.855648 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-cd296373-96be-4ef5-a96d-e3945a51355f req-3ef7d88b-cc01-40d8-8c2c-e5ea169aeb64 service nova] Creating event network-changed:789e4df0-1af5-4f96-9194-ab12ac1b5047 for instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 on hv-cinder-83538 Aug 19 15:26:16.860961 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-cd296373-96be-4ef5-a96d-e3945a51355f req-3ef7d88b-cc01-40d8-8c2c-e5ea169aeb64 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039007 Aug 19 15:26:16.861724 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 193/401] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:26:17.189311 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d795c9d1-d538-4d8a-a1a1-d1a1aa9f7bcb tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:17.189955 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d795c9d1-d538-4d8a-a1a1-d1a1aa9f7bcb tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:17.196896 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d795c9d1-d538-4d8a-a1a1-d1a1aa9f7bcb tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:17.197385 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d795c9d1-d538-4d8a-a1a1-d1a1aa9f7bcb tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:17.197911 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d795c9d1-d538-4d8a-a1a1-d1a1aa9f7bcb tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:17.198939 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d795c9d1-d538-4d8a-a1a1-d1a1aa9f7bcb tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:17.199393 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d795c9d1-d538-4d8a-a1a1-d1a1aa9f7bcb tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:17.200020 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d795c9d1-d538-4d8a-a1a1-d1a1aa9f7bcb tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:17.358366 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d795c9d1-d538-4d8a-a1a1-d1a1aa9f7bcb tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:17.366442 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d795c9d1-d538-4d8a-a1a1-d1a1aa9f7bcb tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1514 microversion: 2.1 time: 0.180933 Aug 19 15:26:17.367033 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 209/402] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:17 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:18.396860 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ac4ac228-8571-4292-bbd0-13aaf523251c tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:18.399191 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ac4ac228-8571-4292-bbd0-13aaf523251c tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:18.408657 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac4ac228-8571-4292-bbd0-13aaf523251c tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:18.409293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac4ac228-8571-4292-bbd0-13aaf523251c tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:18.410205 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac4ac228-8571-4292-bbd0-13aaf523251c tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:18.411036 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac4ac228-8571-4292-bbd0-13aaf523251c tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:18.411479 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac4ac228-8571-4292-bbd0-13aaf523251c tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:18.412000 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac4ac228-8571-4292-bbd0-13aaf523251c tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:18.582608 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ac4ac228-8571-4292-bbd0-13aaf523251c tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:18.591907 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ac4ac228-8571-4292-bbd0-13aaf523251c tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1514 microversion: 2.1 time: 0.203375 Aug 19 15:26:18.592831 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 194/403] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:18 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:19.233991 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-c59fc0da-6d6a-4789-84cf-0382e748a009 req-c69206fc-97bb-41e3-b2e9-51089a71d384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7452037-dcc4-487a-8552-4b6d02b2dabb", "name": "network-vif-deleted", "tag": "2263536a-3085-4d33-91ef-bd0605452053"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:26:19.247415 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c59fc0da-6d6a-4789-84cf-0382e748a009 req-c69206fc-97bb-41e3-b2e9-51089a71d384 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:19.248318 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c59fc0da-6d6a-4789-84cf-0382e748a009 req-c69206fc-97bb-41e3-b2e9-51089a71d384 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:19.249449 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c59fc0da-6d6a-4789-84cf-0382e748a009 req-c69206fc-97bb-41e3-b2e9-51089a71d384 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:19.266986 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-c59fc0da-6d6a-4789-84cf-0382e748a009 req-c69206fc-97bb-41e3-b2e9-51089a71d384 service nova] Creating event network-vif-deleted:2263536a-3085-4d33-91ef-bd0605452053 for instance e7452037-dcc4-487a-8552-4b6d02b2dabb on hv-cinder-83538 Aug 19 15:26:19.272636 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-c59fc0da-6d6a-4789-84cf-0382e748a009 req-c69206fc-97bb-41e3-b2e9-51089a71d384 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047047 Aug 19 15:26:19.273440 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 210/404] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:26:19.616299 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e1b509f9-ebb3-4245-b8a9-74e1c7a0030a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:19.617376 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e1b509f9-ebb3-4245-b8a9-74e1c7a0030a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:19.626574 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b509f9-ebb3-4245-b8a9-74e1c7a0030a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:19.627698 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b509f9-ebb3-4245-b8a9-74e1c7a0030a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:19.627698 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b509f9-ebb3-4245-b8a9-74e1c7a0030a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:19.628248 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b509f9-ebb3-4245-b8a9-74e1c7a0030a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:19.629004 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b509f9-ebb3-4245-b8a9-74e1c7a0030a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:19.629235 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b509f9-ebb3-4245-b8a9-74e1c7a0030a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:19.674721 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b509f9-ebb3-4245-b8a9-74e1c7a0030a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:19.675651 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b509f9-ebb3-4245-b8a9-74e1c7a0030a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:19.676623 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b509f9-ebb3-4245-b8a9-74e1c7a0030a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:19.677421 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-e1b509f9-ebb3-4245-b8a9-74e1c7a0030a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lazy-loading 'fault' on Instance uuid e7452037-dcc4-487a-8552-4b6d02b2dabb {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:26:19.727051 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e1b509f9-ebb3-4245-b8a9-74e1c7a0030a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:19.739350 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e1b509f9-ebb3-4245-b8a9-74e1c7a0030a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 200 len: 1308 microversion: 2.1 time: 0.128702 Aug 19 15:26:19.740240 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 195/405] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:19 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 1308 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:20.764843 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0234927d-f3e9-4867-b7ba-58ee39f3e235 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:20.765546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0234927d-f3e9-4867-b7ba-58ee39f3e235 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: e7452037-dcc4-487a-8552-4b6d02b2dabb] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:20.771818 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0234927d-f3e9-4867-b7ba-58ee39f3e235 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:20.772298 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0234927d-f3e9-4867-b7ba-58ee39f3e235 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:20.772751 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0234927d-f3e9-4867-b7ba-58ee39f3e235 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:20.773446 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0234927d-f3e9-4867-b7ba-58ee39f3e235 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:20.773896 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0234927d-f3e9-4867-b7ba-58ee39f3e235 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:20.774313 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0234927d-f3e9-4867-b7ba-58ee39f3e235 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:20.788725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-0234927d-f3e9-4867-b7ba-58ee39f3e235 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] HTTP exception thrown: Instance e7452037-dcc4-487a-8552-4b6d02b2dabb could not be found. Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0234927d-f3e9-4867-b7ba-58ee39f3e235 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Request method failure captured: Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb HTTP/1.1 Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6tKbdbvSNta-CCsiIcU3dyAkMrYyVRkwZ2x4RZBDeKUNQFRccz33hu-Qhjf6UiYmIjA2QLX2k3mAxe5Ab1aizqjMDJKYMI9WCWQ1edO_Uyt1B2z62KxJ8VgTy38LRPRHUTBscvc_HHMWpRX3HVsryE_h3FwM8UPLiDt0Fk9YTJrA3E Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: 42b848bb5725477b8832057b56c9cf4d Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesSnapshotTestJSON-353293627 Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:26:20.790382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:26:20.792382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_42b848bb5725477b8832057b56c9cf4d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/42b848bb5725477b8832057b56c9cf4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/42b848bb5725477b8832057b56c9cf4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/42b848bb5725477b8832057b56c9cf4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:26:20.792382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesSnapshotTestJSON-353293627 Aug 19 15:26:20.792382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 42b848bb5725477b8832057b56c9cf4d Aug 19 15:26:20.792382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-353293627 Aug 19 15:26:20.792382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesSnapshotTestJSON-353293627-project Aug 19 15:26:20.792382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:26:20.792382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:26:20.792382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 1be80a6a93454cd8b7128e976308bd4b Aug 19 15:26:20.792382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesSnapshotTestJSON-353293627-project Aug 19 15:26:20.792382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:26:20.792382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance e7452037-dcc4-487a-8552-4b6d02b2dabb could not be found. Aug 19 15:26:20.792382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': 'e7452037-dcc4-487a-8552-4b6d02b2dabb'} Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7452037-dcc4-487a-8552-4b6d02b2dabb could not be found. Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:26:20.793182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:26:20.795270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:26:20.795270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:26:20.795270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:26:20.795270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:26:20.795270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:26:20.795270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:26:20.795270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:26:20.795270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7452037-dcc4-487a-8552-4b6d02b2dabb could not be found. Aug 19 15:26:20.795270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:26:20.795270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:26:20.795270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:26:20.795270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:26:20.795270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:26:20.795270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:26:20.795270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:26:20.795270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:26:20.795270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7452037-dcc4-487a-8552-4b6d02b2dabb could not be found. Aug 19 15:26:20.795270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:26:20.797996 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0234927d-f3e9-4867-b7ba-58ee39f3e235 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Returning 404 to user: Instance e7452037-dcc4-487a-8552-4b6d02b2dabb could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:26:20.797996 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0234927d-f3e9-4867-b7ba-58ee39f3e235 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb" status: 404 len: 111 microversion: 2.1 time: 0.031912 Aug 19 15:26:20.797996 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 211/406] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:20 2022] GET /compute/v2.1/servers/e7452037-dcc4-487a-8552-4b6d02b2dabb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:26:26.775325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0fac83f7-0d5a-48d2-b7ff-e187539a3fee tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-916477067", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1301407205", "security_groups": [{"name": "tempest-secgroup-smoke-614027275"}], "block_device_mapping_v2": [{"uuid": "88708637-bef6-40cc-9a68-12ea6ff3b3d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6ddc4f9f-3c90-4d2a-9cf9-1e79206f98a8"}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:26:26.916135 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-0fac83f7-0d5a-48d2-b7ff-e187539a3fee tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] validate_networks() for [('6ddc4f9f-3c90-4d2a-9cf9-1e79206f98a8', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:26:27.319218 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0fac83f7-0d5a-48d2-b7ff-e187539a3fee tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:26:27.319627 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0fac83f7-0d5a-48d2-b7ff-e187539a3fee tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:26:27.320092 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0fac83f7-0d5a-48d2-b7ff-e187539a3fee tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:26:27.320557 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0fac83f7-0d5a-48d2-b7ff-e187539a3fee tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:26:27.320957 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0fac83f7-0d5a-48d2-b7ff-e187539a3fee tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:26:27.330529 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fac83f7-0d5a-48d2-b7ff-e187539a3fee tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:27.331003 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fac83f7-0d5a-48d2-b7ff-e187539a3fee tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:27.331425 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fac83f7-0d5a-48d2-b7ff-e187539a3fee tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:27.332137 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fac83f7-0d5a-48d2-b7ff-e187539a3fee tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:27.332614 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fac83f7-0d5a-48d2-b7ff-e187539a3fee tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:27.333029 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fac83f7-0d5a-48d2-b7ff-e187539a3fee tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:27.350975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-0fac83f7-0d5a-48d2-b7ff-e187539a3fee tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Getting quotas for project 0add00db6668475093f558e9700333d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:26:27.354965 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-0fac83f7-0d5a-48d2-b7ff-e187539a3fee tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Getting quotas for user af3e7eea0b2840b79404b370382ab44a and project 0add00db6668475093f558e9700333d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:26:27.413609 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0fac83f7-0d5a-48d2-b7ff-e187539a3fee tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:26:27.415715 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0fac83f7-0d5a-48d2-b7ff-e187539a3fee tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='88708637-bef6-40cc-9a68-12ea6ff3b3d2',volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:26:27.565026 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0fac83f7-0d5a-48d2-b7ff-e187539a3fee tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.796320 Aug 19 15:26:27.571648 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 196/407] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:26:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 15:26:27.578890 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b77063df-5b1a-4cee-8af4-dfb0d607051b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:27.579489 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b77063df-5b1a-4cee-8af4-dfb0d607051b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:27.650562 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b77063df-5b1a-4cee-8af4-dfb0d607051b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:27.657925 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b77063df-5b1a-4cee-8af4-dfb0d607051b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1094 microversion: 2.1 time: 0.084399 Aug 19 15:26:27.658401 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 212/408] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:27 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:28.688415 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f98ddd58-e0ba-4a34-9f31-f5e4a4bc8b52 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:28.689129 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f98ddd58-e0ba-4a34-9f31-f5e4a4bc8b52 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:28.695844 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f98ddd58-e0ba-4a34-9f31-f5e4a4bc8b52 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:28.696325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f98ddd58-e0ba-4a34-9f31-f5e4a4bc8b52 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:28.696787 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f98ddd58-e0ba-4a34-9f31-f5e4a4bc8b52 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:28.697469 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f98ddd58-e0ba-4a34-9f31-f5e4a4bc8b52 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:28.697935 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f98ddd58-e0ba-4a34-9f31-f5e4a4bc8b52 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:28.699003 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f98ddd58-e0ba-4a34-9f31-f5e4a4bc8b52 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:28.764861 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f98ddd58-e0ba-4a34-9f31-f5e4a4bc8b52 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:28.772690 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f98ddd58-e0ba-4a34-9f31-f5e4a4bc8b52 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1144 microversion: 2.1 time: 0.088491 Aug 19 15:26:28.773281 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 197/409] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:28 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:26:29.774334 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f172243d-2a99-422f-978e-fd85c62a9fb7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1574247076", "imageRef": "27174b76-85e7-4123-a2bc-847959ca59f2", "flavorRef": "452", "networks": [{"uuid": "37d539b3-8a9d-4ad1-b572-f18d00ea3641"}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:26:29.793765 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f4928a14-4981-41ab-b6de-c5084f5ad441 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:29.794655 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f4928a14-4981-41ab-b6de-c5084f5ad441 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:29.801553 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4928a14-4981-41ab-b6de-c5084f5ad441 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:29.802047 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4928a14-4981-41ab-b6de-c5084f5ad441 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:29.802477 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4928a14-4981-41ab-b6de-c5084f5ad441 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:29.803169 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4928a14-4981-41ab-b6de-c5084f5ad441 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:29.803615 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4928a14-4981-41ab-b6de-c5084f5ad441 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:29.804034 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4928a14-4981-41ab-b6de-c5084f5ad441 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:29.831626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-f172243d-2a99-422f-978e-fd85c62a9fb7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] validate_networks() for [('37d539b3-8a9d-4ad1-b572-f18d00ea3641', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:26:29.897167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f4928a14-4981-41ab-b6de-c5084f5ad441 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:29.907879 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f4928a14-4981-41ab-b6de-c5084f5ad441 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1192 microversion: 2.1 time: 0.118067 Aug 19 15:26:29.908991 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 198/410] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:29 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1192 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:26:30.298898 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-f172243d-2a99-422f-978e-fd85c62a9fb7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:26:30.299520 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-f172243d-2a99-422f-978e-fd85c62a9fb7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:26:30.300126 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-f172243d-2a99-422f-978e-fd85c62a9fb7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:26:30.300823 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-f172243d-2a99-422f-978e-fd85c62a9fb7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:26:30.301833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-f172243d-2a99-422f-978e-fd85c62a9fb7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:26:30.318515 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f172243d-2a99-422f-978e-fd85c62a9fb7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:30.318751 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f172243d-2a99-422f-978e-fd85c62a9fb7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:30.319360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f172243d-2a99-422f-978e-fd85c62a9fb7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:30.320568 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f172243d-2a99-422f-978e-fd85c62a9fb7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:30.321281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f172243d-2a99-422f-978e-fd85c62a9fb7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:30.321985 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f172243d-2a99-422f-978e-fd85c62a9fb7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:30.350367 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-f172243d-2a99-422f-978e-fd85c62a9fb7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Getting quotas for project 42b848bb5725477b8832057b56c9cf4d. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:26:30.355408 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-f172243d-2a99-422f-978e-fd85c62a9fb7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Getting quotas for user 1be80a6a93454cd8b7128e976308bd4b and project 42b848bb5725477b8832057b56c9cf4d. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:26:30.367558 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f172243d-2a99-422f-978e-fd85c62a9fb7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:26:30.370574 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f172243d-2a99-422f-978e-fd85c62a9fb7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27174b76-85e7-4123-a2bc-847959ca59f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:26:30.427261 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f172243d-2a99-422f-978e-fd85c62a9fb7 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650561 Aug 19 15:26:30.427261 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 213/411] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:26:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 15:26:30.434771 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4bf1ad76-d280-497e-802d-867c0fca479d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:30.435384 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4bf1ad76-d280-497e-802d-867c0fca479d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:30.511902 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4bf1ad76-d280-497e-802d-867c0fca479d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:30.527006 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4bf1ad76-d280-497e-802d-867c0fca479d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce" status: 200 len: 1219 microversion: 2.1 time: 0.097004 Aug 19 15:26:30.527732 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 199/412] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:30 2022] GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:30.936913 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-100082a6-60d0-4e62-90dc-807ea74783af tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:30.938295 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-100082a6-60d0-4e62-90dc-807ea74783af tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:30.951626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-100082a6-60d0-4e62-90dc-807ea74783af tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:30.952115 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-100082a6-60d0-4e62-90dc-807ea74783af tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:30.952582 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-100082a6-60d0-4e62-90dc-807ea74783af tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:30.953285 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-100082a6-60d0-4e62-90dc-807ea74783af tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:30.953731 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-100082a6-60d0-4e62-90dc-807ea74783af tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:30.954423 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-100082a6-60d0-4e62-90dc-807ea74783af tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:31.028767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-100082a6-60d0-4e62-90dc-807ea74783af tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:31.039022 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-100082a6-60d0-4e62-90dc-807ea74783af tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1198 microversion: 2.1 time: 0.111015 Aug 19 15:26:31.039603 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 214/413] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:30 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1198 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:31.559897 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c8df39a6-3b2f-4b23-95f8-844646db6bb6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:31.560779 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c8df39a6-3b2f-4b23-95f8-844646db6bb6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:31.568309 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8df39a6-3b2f-4b23-95f8-844646db6bb6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:31.582398 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8df39a6-3b2f-4b23-95f8-844646db6bb6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:31.582987 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8df39a6-3b2f-4b23-95f8-844646db6bb6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:31.583746 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8df39a6-3b2f-4b23-95f8-844646db6bb6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:31.584208 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8df39a6-3b2f-4b23-95f8-844646db6bb6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:31.584641 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8df39a6-3b2f-4b23-95f8-844646db6bb6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:31.664329 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c8df39a6-3b2f-4b23-95f8-844646db6bb6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:31.679571 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c8df39a6-3b2f-4b23-95f8-844646db6bb6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce" status: 200 len: 1279 microversion: 2.1 time: 0.125166 Aug 19 15:26:31.680858 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 200/414] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:31 2022] GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce => generated 1279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:32.062105 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1e3cbc8a-d90f-4a68-94e6-ec1077014dae tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:32.062709 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1e3cbc8a-d90f-4a68-94e6-ec1077014dae tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:32.069546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e3cbc8a-d90f-4a68-94e6-ec1077014dae tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:32.070083 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e3cbc8a-d90f-4a68-94e6-ec1077014dae tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:32.070459 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e3cbc8a-d90f-4a68-94e6-ec1077014dae tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:32.071156 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e3cbc8a-d90f-4a68-94e6-ec1077014dae tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:32.071606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e3cbc8a-d90f-4a68-94e6-ec1077014dae tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:32.072023 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e3cbc8a-d90f-4a68-94e6-ec1077014dae tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:32.233409 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1e3cbc8a-d90f-4a68-94e6-ec1077014dae tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:32.241774 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1e3cbc8a-d90f-4a68-94e6-ec1077014dae tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1265 microversion: 2.1 time: 0.183756 Aug 19 15:26:32.242457 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 215/415] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:32 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:32.449842 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-91c06586-df3c-4248-9552-9ae0d44bac0d req-a51b9d6c-f28e-47d0-8b54-a520433480cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfb210f1-d4a9-4f36-8880-0d17b7e81557", "tag": "d6f269ef-65e3-4c71-9074-4a4034f13618"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:26:32.462225 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-91c06586-df3c-4248-9552-9ae0d44bac0d req-a51b9d6c-f28e-47d0-8b54-a520433480cd service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:32.462707 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-91c06586-df3c-4248-9552-9ae0d44bac0d req-a51b9d6c-f28e-47d0-8b54-a520433480cd service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:32.463137 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-91c06586-df3c-4248-9552-9ae0d44bac0d req-a51b9d6c-f28e-47d0-8b54-a520433480cd service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:32.479698 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-91c06586-df3c-4248-9552-9ae0d44bac0d req-a51b9d6c-f28e-47d0-8b54-a520433480cd service nova] Creating event network-changed:d6f269ef-65e3-4c71-9074-4a4034f13618 for instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 on hv-cinder-83538 Aug 19 15:26:32.485813 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-91c06586-df3c-4248-9552-9ae0d44bac0d req-a51b9d6c-f28e-47d0-8b54-a520433480cd service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040218 Aug 19 15:26:32.486742 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 201/416] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:26:32.705419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-00b7b540-b517-4f0f-8ec3-18a680bb0f2f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:32.706030 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-00b7b540-b517-4f0f-8ec3-18a680bb0f2f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:32.712793 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00b7b540-b517-4f0f-8ec3-18a680bb0f2f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:32.713277 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00b7b540-b517-4f0f-8ec3-18a680bb0f2f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:32.714487 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00b7b540-b517-4f0f-8ec3-18a680bb0f2f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:32.715216 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00b7b540-b517-4f0f-8ec3-18a680bb0f2f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:32.715665 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00b7b540-b517-4f0f-8ec3-18a680bb0f2f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:32.716078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00b7b540-b517-4f0f-8ec3-18a680bb0f2f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:32.784068 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-00b7b540-b517-4f0f-8ec3-18a680bb0f2f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:32.793795 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-00b7b540-b517-4f0f-8ec3-18a680bb0f2f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce" status: 200 len: 1277 microversion: 2.1 time: 0.095237 Aug 19 15:26:32.794648 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 216/417] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:32 2022] GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce => generated 1277 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:33.264530 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-524fe285-a0f8-41c6-a929-e2242612830d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:33.265338 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-524fe285-a0f8-41c6-a929-e2242612830d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:33.278739 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-524fe285-a0f8-41c6-a929-e2242612830d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:33.279204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-524fe285-a0f8-41c6-a929-e2242612830d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:33.279645 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-524fe285-a0f8-41c6-a929-e2242612830d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:33.280346 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-524fe285-a0f8-41c6-a929-e2242612830d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:33.280836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-524fe285-a0f8-41c6-a929-e2242612830d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:33.281259 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-524fe285-a0f8-41c6-a929-e2242612830d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:33.423610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-524fe285-a0f8-41c6-a929-e2242612830d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:33.431700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-524fe285-a0f8-41c6-a929-e2242612830d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1265 microversion: 2.1 time: 0.171887 Aug 19 15:26:33.432909 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 202/418] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:33 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:33.815785 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ffcc9e04-a9d8-4238-a8a2-eaf6f237326d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:33.816524 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ffcc9e04-a9d8-4238-a8a2-eaf6f237326d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:33.824752 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffcc9e04-a9d8-4238-a8a2-eaf6f237326d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:33.825237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffcc9e04-a9d8-4238-a8a2-eaf6f237326d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:33.825662 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffcc9e04-a9d8-4238-a8a2-eaf6f237326d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:33.826362 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffcc9e04-a9d8-4238-a8a2-eaf6f237326d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:33.826805 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffcc9e04-a9d8-4238-a8a2-eaf6f237326d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:33.827221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffcc9e04-a9d8-4238-a8a2-eaf6f237326d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:33.993413 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ffcc9e04-a9d8-4238-a8a2-eaf6f237326d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:34.001457 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ffcc9e04-a9d8-4238-a8a2-eaf6f237326d tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce" status: 200 len: 1319 microversion: 2.1 time: 0.189470 Aug 19 15:26:34.002031 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 217/419] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:33 2022] GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:34.453178 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2d04d9dc-68e8-48f3-882a-85542b51fccd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:34.453786 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2d04d9dc-68e8-48f3-882a-85542b51fccd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:34.460215 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d04d9dc-68e8-48f3-882a-85542b51fccd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:34.460739 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d04d9dc-68e8-48f3-882a-85542b51fccd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:34.461167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d04d9dc-68e8-48f3-882a-85542b51fccd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:34.461859 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d04d9dc-68e8-48f3-882a-85542b51fccd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:34.462310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d04d9dc-68e8-48f3-882a-85542b51fccd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:34.462728 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d04d9dc-68e8-48f3-882a-85542b51fccd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:34.612902 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2d04d9dc-68e8-48f3-882a-85542b51fccd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:34.621669 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2d04d9dc-68e8-48f3-882a-85542b51fccd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1265 microversion: 2.1 time: 0.172367 Aug 19 15:26:34.622267 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 203/420] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:34 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:34.757179 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-0cc829a8-8a53-47d4-ad70-1e14ef6a4e16 req-ff335a58-28cc-4407-b392-1078c69e635e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac205760-e647-4a14-8071-037941d867ce", "tag": "186f45a6-6f25-464c-b4a4-cb2af2dbcb29"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:26:34.767536 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-0cc829a8-8a53-47d4-ad70-1e14ef6a4e16 req-ff335a58-28cc-4407-b392-1078c69e635e service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:34.768189 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-0cc829a8-8a53-47d4-ad70-1e14ef6a4e16 req-ff335a58-28cc-4407-b392-1078c69e635e service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:34.768691 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-0cc829a8-8a53-47d4-ad70-1e14ef6a4e16 req-ff335a58-28cc-4407-b392-1078c69e635e service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:34.772897 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=95 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:26:34.781669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-0cc829a8-8a53-47d4-ad70-1e14ef6a4e16 req-ff335a58-28cc-4407-b392-1078c69e635e service nova] Creating event network-changed:186f45a6-6f25-464c-b4a4-cb2af2dbcb29 for instance ac205760-e647-4a14-8071-037941d867ce on hv-cinder-83538 Aug 19 15:26:34.786721 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-0cc829a8-8a53-47d4-ad70-1e14ef6a4e16 req-ff335a58-28cc-4407-b392-1078c69e635e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033169 Aug 19 15:26:34.787466 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 218/421] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:26:35.022169 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3c881dc4-a90a-4458-a4a2-80d45441e77f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:35.022768 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3c881dc4-a90a-4458-a4a2-80d45441e77f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:35.029406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c881dc4-a90a-4458-a4a2-80d45441e77f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:35.029882 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c881dc4-a90a-4458-a4a2-80d45441e77f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:35.030305 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c881dc4-a90a-4458-a4a2-80d45441e77f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:35.030990 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c881dc4-a90a-4458-a4a2-80d45441e77f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:35.031426 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c881dc4-a90a-4458-a4a2-80d45441e77f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:35.031836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c881dc4-a90a-4458-a4a2-80d45441e77f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:35.170418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3c881dc4-a90a-4458-a4a2-80d45441e77f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:35.178193 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3c881dc4-a90a-4458-a4a2-80d45441e77f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce" status: 200 len: 1319 microversion: 2.1 time: 0.159892 Aug 19 15:26:35.178761 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 204/422] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:35 2022] GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:35.644118 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-39ca276d-f5b3-4cc1-9c3c-e9f687930e98 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:35.644849 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-39ca276d-f5b3-4cc1-9c3c-e9f687930e98 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:35.651955 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39ca276d-f5b3-4cc1-9c3c-e9f687930e98 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:35.652472 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39ca276d-f5b3-4cc1-9c3c-e9f687930e98 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:35.652911 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39ca276d-f5b3-4cc1-9c3c-e9f687930e98 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:35.653610 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39ca276d-f5b3-4cc1-9c3c-e9f687930e98 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:35.654061 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39ca276d-f5b3-4cc1-9c3c-e9f687930e98 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:35.654484 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39ca276d-f5b3-4cc1-9c3c-e9f687930e98 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:35.789810 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-39ca276d-f5b3-4cc1-9c3c-e9f687930e98 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:35.798786 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-39ca276d-f5b3-4cc1-9c3c-e9f687930e98 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1265 microversion: 2.1 time: 0.159358 Aug 19 15:26:35.799345 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 219/423] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:35 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:36.198470 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bf485f07-2912-4bd8-ac7b-dd64a6c3032a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:36.199189 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bf485f07-2912-4bd8-ac7b-dd64a6c3032a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:36.205864 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf485f07-2912-4bd8-ac7b-dd64a6c3032a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:36.206342 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf485f07-2912-4bd8-ac7b-dd64a6c3032a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:36.206772 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf485f07-2912-4bd8-ac7b-dd64a6c3032a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:36.207452 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf485f07-2912-4bd8-ac7b-dd64a6c3032a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:36.207903 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf485f07-2912-4bd8-ac7b-dd64a6c3032a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:36.208322 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf485f07-2912-4bd8-ac7b-dd64a6c3032a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:36.344654 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bf485f07-2912-4bd8-ac7b-dd64a6c3032a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:36.352359 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bf485f07-2912-4bd8-ac7b-dd64a6c3032a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce" status: 200 len: 1319 microversion: 2.1 time: 0.157846 Aug 19 15:26:36.352956 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 205/424] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:36 2022] GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:36.819539 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-25d95852-dd64-4152-bef9-130aded4803f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:36.820127 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-25d95852-dd64-4152-bef9-130aded4803f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:36.827470 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25d95852-dd64-4152-bef9-130aded4803f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:36.827938 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25d95852-dd64-4152-bef9-130aded4803f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:36.828360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25d95852-dd64-4152-bef9-130aded4803f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:36.829059 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25d95852-dd64-4152-bef9-130aded4803f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:36.829503 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25d95852-dd64-4152-bef9-130aded4803f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:36.829916 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25d95852-dd64-4152-bef9-130aded4803f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:36.967418 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-25d95852-dd64-4152-bef9-130aded4803f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:36.975438 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-25d95852-dd64-4152-bef9-130aded4803f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1265 microversion: 2.1 time: 0.159673 Aug 19 15:26:36.976204 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 220/425] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:36 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:37.374252 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-372ac9fd-c0ef-4e88-9101-990638a36e0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:37.374959 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-372ac9fd-c0ef-4e88-9101-990638a36e0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:37.377479 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:26:37.383008 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-372ac9fd-c0ef-4e88-9101-990638a36e0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:37.383487 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-372ac9fd-c0ef-4e88-9101-990638a36e0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:37.383914 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-372ac9fd-c0ef-4e88-9101-990638a36e0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:37.384623 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-372ac9fd-c0ef-4e88-9101-990638a36e0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:37.385067 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-372ac9fd-c0ef-4e88-9101-990638a36e0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:37.385703 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-372ac9fd-c0ef-4e88-9101-990638a36e0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:37.535227 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-372ac9fd-c0ef-4e88-9101-990638a36e0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:37.545179 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-372ac9fd-c0ef-4e88-9101-990638a36e0e tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce" status: 200 len: 1319 microversion: 2.1 time: 0.175197 Aug 19 15:26:37.545749 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 206/426] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:37 2022] GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:37.997599 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-09938b9f-1f48-47b8-8015-61933d802552 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:37.998245 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-09938b9f-1f48-47b8-8015-61933d802552 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:38.004718 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09938b9f-1f48-47b8-8015-61933d802552 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:38.005197 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09938b9f-1f48-47b8-8015-61933d802552 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:38.005631 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09938b9f-1f48-47b8-8015-61933d802552 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:38.006326 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09938b9f-1f48-47b8-8015-61933d802552 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:38.006780 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09938b9f-1f48-47b8-8015-61933d802552 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:38.007203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09938b9f-1f48-47b8-8015-61933d802552 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:38.137699 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-09938b9f-1f48-47b8-8015-61933d802552 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:38.145390 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-09938b9f-1f48-47b8-8015-61933d802552 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1265 microversion: 2.1 time: 0.152566 Aug 19 15:26:38.145955 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 221/427] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:37 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:38.565238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-106b4008-11e6-4c59-bb32-561c8bed4ec6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:38.565853 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-106b4008-11e6-4c59-bb32-561c8bed4ec6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:38.572206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-106b4008-11e6-4c59-bb32-561c8bed4ec6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:38.572748 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-106b4008-11e6-4c59-bb32-561c8bed4ec6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:38.573515 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-106b4008-11e6-4c59-bb32-561c8bed4ec6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:38.574252 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-106b4008-11e6-4c59-bb32-561c8bed4ec6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:38.574697 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-106b4008-11e6-4c59-bb32-561c8bed4ec6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:38.575115 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-106b4008-11e6-4c59-bb32-561c8bed4ec6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:38.711272 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-106b4008-11e6-4c59-bb32-561c8bed4ec6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:38.719559 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-106b4008-11e6-4c59-bb32-561c8bed4ec6 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce" status: 200 len: 1319 microversion: 2.1 time: 0.158168 Aug 19 15:26:38.720127 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 207/428] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:38 2022] GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:39.167102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e630763b-f0a5-4073-b9b7-e4b415514829 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:39.167782 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e630763b-f0a5-4073-b9b7-e4b415514829 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:39.170525 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:26:39.176668 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e630763b-f0a5-4073-b9b7-e4b415514829 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:39.177153 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e630763b-f0a5-4073-b9b7-e4b415514829 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:39.177582 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e630763b-f0a5-4073-b9b7-e4b415514829 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:39.178286 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e630763b-f0a5-4073-b9b7-e4b415514829 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:39.178726 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e630763b-f0a5-4073-b9b7-e4b415514829 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:39.179141 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e630763b-f0a5-4073-b9b7-e4b415514829 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:39.198874 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-238144b4-7336-410f-a2ee-dddadd87a798 req-543a478e-0cf5-4e81-b943-e6d158b9a06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac205760-e647-4a14-8071-037941d867ce", "name": "network-vif-plugged", "status": "completed", "tag": "186f45a6-6f25-464c-b4a4-cb2af2dbcb29"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:26:39.210027 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-238144b4-7336-410f-a2ee-dddadd87a798 req-543a478e-0cf5-4e81-b943-e6d158b9a06c service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:39.210562 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-238144b4-7336-410f-a2ee-dddadd87a798 req-543a478e-0cf5-4e81-b943-e6d158b9a06c service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:39.211397 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-238144b4-7336-410f-a2ee-dddadd87a798 req-543a478e-0cf5-4e81-b943-e6d158b9a06c service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:39.223862 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-238144b4-7336-410f-a2ee-dddadd87a798 req-543a478e-0cf5-4e81-b943-e6d158b9a06c service nova] Creating event network-vif-plugged:186f45a6-6f25-464c-b4a4-cb2af2dbcb29 for instance ac205760-e647-4a14-8071-037941d867ce on hv-cinder-83538 Aug 19 15:26:39.229821 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-238144b4-7336-410f-a2ee-dddadd87a798 req-543a478e-0cf5-4e81-b943-e6d158b9a06c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034060 Aug 19 15:26:39.230519 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 208/429] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:26:39.332636 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e630763b-f0a5-4073-b9b7-e4b415514829 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:39.341093 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e630763b-f0a5-4073-b9b7-e4b415514829 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1265 microversion: 2.1 time: 0.178533 Aug 19 15:26:39.341712 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 222/430] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:39 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:39.740530 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-be19c765-e728-4e7b-b4ea-4b85f0f7b49f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:39.741511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-be19c765-e728-4e7b-b4ea-4b85f0f7b49f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:39.748776 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be19c765-e728-4e7b-b4ea-4b85f0f7b49f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:39.749250 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be19c765-e728-4e7b-b4ea-4b85f0f7b49f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:39.749672 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be19c765-e728-4e7b-b4ea-4b85f0f7b49f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:39.750341 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be19c765-e728-4e7b-b4ea-4b85f0f7b49f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:39.750783 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be19c765-e728-4e7b-b4ea-4b85f0f7b49f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:39.751196 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be19c765-e728-4e7b-b4ea-4b85f0f7b49f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:39.888469 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-be19c765-e728-4e7b-b4ea-4b85f0f7b49f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:39.896118 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-be19c765-e728-4e7b-b4ea-4b85f0f7b49f tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce" status: 200 len: 1319 microversion: 2.1 time: 0.159805 Aug 19 15:26:39.896731 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 209/431] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:39 2022] GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:40.362329 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bf0e642c-c06e-4bdc-ac08-bf631bb9277e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:40.362941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bf0e642c-c06e-4bdc-ac08-bf631bb9277e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:40.365279 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:26:40.366102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=8 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:26:40.372101 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf0e642c-c06e-4bdc-ac08-bf631bb9277e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:40.372698 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf0e642c-c06e-4bdc-ac08-bf631bb9277e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:40.373134 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf0e642c-c06e-4bdc-ac08-bf631bb9277e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:40.373833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf0e642c-c06e-4bdc-ac08-bf631bb9277e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:40.374286 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf0e642c-c06e-4bdc-ac08-bf631bb9277e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:40.374710 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf0e642c-c06e-4bdc-ac08-bf631bb9277e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:40.510762 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bf0e642c-c06e-4bdc-ac08-bf631bb9277e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:40.518507 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bf0e642c-c06e-4bdc-ac08-bf631bb9277e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1265 microversion: 2.1 time: 0.160041 Aug 19 15:26:40.519065 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 223/432] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:40 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:40.917617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f8471610-5b48-4dc1-be2d-0cdda0f05221 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:40.919182 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f8471610-5b48-4dc1-be2d-0cdda0f05221 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:40.921421 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=8 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:26:40.927760 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8471610-5b48-4dc1-be2d-0cdda0f05221 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:40.928178 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8471610-5b48-4dc1-be2d-0cdda0f05221 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:40.928653 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8471610-5b48-4dc1-be2d-0cdda0f05221 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:40.929351 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8471610-5b48-4dc1-be2d-0cdda0f05221 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:40.929801 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8471610-5b48-4dc1-be2d-0cdda0f05221 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:40.930252 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8471610-5b48-4dc1-be2d-0cdda0f05221 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:41.074279 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f8471610-5b48-4dc1-be2d-0cdda0f05221 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:41.082029 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f8471610-5b48-4dc1-be2d-0cdda0f05221 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce" status: 200 len: 1319 microversion: 2.1 time: 0.168656 Aug 19 15:26:41.082606 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 210/433] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:40 2022] GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:41.538779 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a711dbf6-08b2-4b94-93e9-0b83ff5cf864 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:41.539479 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a711dbf6-08b2-4b94-93e9-0b83ff5cf864 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:41.547031 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a711dbf6-08b2-4b94-93e9-0b83ff5cf864 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:41.547543 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a711dbf6-08b2-4b94-93e9-0b83ff5cf864 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:41.547985 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a711dbf6-08b2-4b94-93e9-0b83ff5cf864 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:41.548793 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a711dbf6-08b2-4b94-93e9-0b83ff5cf864 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:41.549241 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a711dbf6-08b2-4b94-93e9-0b83ff5cf864 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:41.549655 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a711dbf6-08b2-4b94-93e9-0b83ff5cf864 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:41.694814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a711dbf6-08b2-4b94-93e9-0b83ff5cf864 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:41.703931 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a711dbf6-08b2-4b94-93e9-0b83ff5cf864 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1265 microversion: 2.1 time: 0.168959 Aug 19 15:26:41.704680 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 224/434] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:41 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:42.110203 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-93c45ae6-2430-4e29-92c1-4a3be7e22041 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:42.111045 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-93c45ae6-2430-4e29-92c1-4a3be7e22041 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:42.117381 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93c45ae6-2430-4e29-92c1-4a3be7e22041 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:42.117860 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93c45ae6-2430-4e29-92c1-4a3be7e22041 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:42.118283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93c45ae6-2430-4e29-92c1-4a3be7e22041 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:42.118956 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93c45ae6-2430-4e29-92c1-4a3be7e22041 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:42.119399 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93c45ae6-2430-4e29-92c1-4a3be7e22041 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:42.120522 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93c45ae6-2430-4e29-92c1-4a3be7e22041 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:42.257189 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-93c45ae6-2430-4e29-92c1-4a3be7e22041 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:42.265540 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-93c45ae6-2430-4e29-92c1-4a3be7e22041 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce" status: 200 len: 1509 microversion: 2.1 time: 0.159639 Aug 19 15:26:42.266042 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 211/435] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:42 2022] GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:42.285901 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-47350bf3-34da-4f8b-b6c9-8c5d1811ce6a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a5fe83d-93c7-48b6-b90e-7fe0c8e82abf", "device": "/dev/sdb"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:26:42.288714 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-47350bf3-34da-4f8b-b6c9-8c5d1811ce6a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:42.294924 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47350bf3-34da-4f8b-b6c9-8c5d1811ce6a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:42.295407 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47350bf3-34da-4f8b-b6c9-8c5d1811ce6a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:42.295833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47350bf3-34da-4f8b-b6c9-8c5d1811ce6a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:42.296548 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47350bf3-34da-4f8b-b6c9-8c5d1811ce6a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:42.296998 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47350bf3-34da-4f8b-b6c9-8c5d1811ce6a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:42.297414 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47350bf3-34da-4f8b-b6c9-8c5d1811ce6a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:42.531277 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-47350bf3-34da-4f8b-b6c9-8c5d1811ce6a tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "POST /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249061 Aug 19 15:26:42.532024 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 225/436] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Aug 19 15:26:42 2022] POST /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:26:42.725675 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd260066-47d9-4106-8f3f-9146999e53b4 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:42.726275 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd260066-47d9-4106-8f3f-9146999e53b4 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:42.732327 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd260066-47d9-4106-8f3f-9146999e53b4 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:42.732857 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd260066-47d9-4106-8f3f-9146999e53b4 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:42.733285 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd260066-47d9-4106-8f3f-9146999e53b4 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:42.733972 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd260066-47d9-4106-8f3f-9146999e53b4 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:42.734422 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd260066-47d9-4106-8f3f-9146999e53b4 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:42.734843 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd260066-47d9-4106-8f3f-9146999e53b4 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:42.873312 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fd260066-47d9-4106-8f3f-9146999e53b4 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:42.881203 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd260066-47d9-4106-8f3f-9146999e53b4 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1265 microversion: 2.1 time: 0.159594 Aug 19 15:26:42.881773 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 212/437] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:42 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:26:43.241797 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-6819a6b1-bff3-47e5-935e-512876deb25d req-a17a2f1f-8ac7-472e-946c-81847f7124b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb210f1-d4a9-4f36-8880-0d17b7e81557", "name": "network-vif-plugged", "status": "completed", "tag": "d6f269ef-65e3-4c71-9074-4a4034f13618"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:26:43.254017 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6819a6b1-bff3-47e5-935e-512876deb25d req-a17a2f1f-8ac7-472e-946c-81847f7124b6 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:43.254486 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6819a6b1-bff3-47e5-935e-512876deb25d req-a17a2f1f-8ac7-472e-946c-81847f7124b6 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:43.254910 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6819a6b1-bff3-47e5-935e-512876deb25d req-a17a2f1f-8ac7-472e-946c-81847f7124b6 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:43.267546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-6819a6b1-bff3-47e5-935e-512876deb25d req-a17a2f1f-8ac7-472e-946c-81847f7124b6 service nova] Creating event network-vif-plugged:d6f269ef-65e3-4c71-9074-4a4034f13618 for instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 on hv-cinder-83538 Aug 19 15:26:43.272588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-6819a6b1-bff3-47e5-935e-512876deb25d req-a17a2f1f-8ac7-472e-946c-81847f7124b6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035436 Aug 19 15:26:43.273566 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 226/438] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:26:43.904878 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-afbce6e0-d679-4db0-8cf7-6da23abbdf2d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:43.905571 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-afbce6e0-d679-4db0-8cf7-6da23abbdf2d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:43.913178 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afbce6e0-d679-4db0-8cf7-6da23abbdf2d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:43.913673 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afbce6e0-d679-4db0-8cf7-6da23abbdf2d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:43.914108 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afbce6e0-d679-4db0-8cf7-6da23abbdf2d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:43.914804 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afbce6e0-d679-4db0-8cf7-6da23abbdf2d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:43.915255 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afbce6e0-d679-4db0-8cf7-6da23abbdf2d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:43.915678 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afbce6e0-d679-4db0-8cf7-6da23abbdf2d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:43.920923 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:26:44.068018 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-afbce6e0-d679-4db0-8cf7-6da23abbdf2d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:44.080834 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-afbce6e0-d679-4db0-8cf7-6da23abbdf2d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1265 microversion: 2.1 time: 0.181921 Aug 19 15:26:44.081428 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 213/439] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:43 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:26:44.804149 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bfbb16d4-d02b-4e37-95bc-96b23dcfe9bc tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:44.804726 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bfbb16d4-d02b-4e37-95bc-96b23dcfe9bc tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:44.811890 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfbb16d4-d02b-4e37-95bc-96b23dcfe9bc tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:44.812354 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfbb16d4-d02b-4e37-95bc-96b23dcfe9bc tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:44.812808 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfbb16d4-d02b-4e37-95bc-96b23dcfe9bc tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:44.813484 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfbb16d4-d02b-4e37-95bc-96b23dcfe9bc tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:44.813925 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfbb16d4-d02b-4e37-95bc-96b23dcfe9bc tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:44.814336 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfbb16d4-d02b-4e37-95bc-96b23dcfe9bc tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:44.968761 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-bfbb16d4-d02b-4e37-95bc-96b23dcfe9bc tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lazy-loading 'services' on Instance uuid f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:26:45.093570 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bfbb16d4-d02b-4e37-95bc-96b23dcfe9bc tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d/os-volume_attachments/59e7be76-ad89-45e5-a282-00c247b877c0" status: 202 len: 0 microversion: 2.1 time: 0.293534 Aug 19 15:26:45.094236 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 227/440] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Aug 19 15:26:44 2022] DELETE /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d/os-volume_attachments/59e7be76-ad89-45e5-a282-00c247b877c0 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:26:45.102197 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-411d6fff-ce2b-4c34-af19-3aecf019e480 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:45.102799 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-411d6fff-ce2b-4c34-af19-3aecf019e480 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:45.110384 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-411d6fff-ce2b-4c34-af19-3aecf019e480 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:45.110871 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-411d6fff-ce2b-4c34-af19-3aecf019e480 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:45.111293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-411d6fff-ce2b-4c34-af19-3aecf019e480 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:45.111988 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-411d6fff-ce2b-4c34-af19-3aecf019e480 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:45.112454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-411d6fff-ce2b-4c34-af19-3aecf019e480 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:45.112872 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-411d6fff-ce2b-4c34-af19-3aecf019e480 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:45.266568 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-411d6fff-ce2b-4c34-af19-3aecf019e480 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:45.274319 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-411d6fff-ce2b-4c34-af19-3aecf019e480 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1265 microversion: 2.1 time: 0.176128 Aug 19 15:26:45.274883 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 214/441] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:45 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:46.296849 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d95604a6-447e-42fb-8f03-e687b0112a95 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:46.297542 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d95604a6-447e-42fb-8f03-e687b0112a95 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:46.303881 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d95604a6-447e-42fb-8f03-e687b0112a95 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:46.304382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d95604a6-447e-42fb-8f03-e687b0112a95 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:46.304832 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d95604a6-447e-42fb-8f03-e687b0112a95 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:46.305514 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d95604a6-447e-42fb-8f03-e687b0112a95 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:46.305954 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d95604a6-447e-42fb-8f03-e687b0112a95 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:46.306365 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d95604a6-447e-42fb-8f03-e687b0112a95 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:46.446412 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d95604a6-447e-42fb-8f03-e687b0112a95 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:46.454349 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d95604a6-447e-42fb-8f03-e687b0112a95 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1452 microversion: 2.1 time: 0.163118 Aug 19 15:26:46.454914 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 228/442] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:46 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:46.535385 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1a1dc623-43ca-4fd2-a909-1d9d51b3fe9e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:46.535967 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1a1dc623-43ca-4fd2-a909-1d9d51b3fe9e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:46.538381 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:26:46.544225 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a1dc623-43ca-4fd2-a909-1d9d51b3fe9e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:46.544731 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a1dc623-43ca-4fd2-a909-1d9d51b3fe9e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:46.545413 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a1dc623-43ca-4fd2-a909-1d9d51b3fe9e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:46.546097 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a1dc623-43ca-4fd2-a909-1d9d51b3fe9e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:46.546542 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a1dc623-43ca-4fd2-a909-1d9d51b3fe9e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:46.546955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a1dc623-43ca-4fd2-a909-1d9d51b3fe9e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:46.690687 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1a1dc623-43ca-4fd2-a909-1d9d51b3fe9e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:46.699619 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1a1dc623-43ca-4fd2-a909-1d9d51b3fe9e tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1452 microversion: 2.1 time: 0.167728 Aug 19 15:26:46.700102 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 215/443] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:46 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:48.737971 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-577e4d98-13b8-43c0-bcb5-25b3677f0ffd req-312645ad-2784-41a8-8c60-189c48cdace4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfb210f1-d4a9-4f36-8880-0d17b7e81557", "tag": "d6f269ef-65e3-4c71-9074-4a4034f13618"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:26:48.749219 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-577e4d98-13b8-43c0-bcb5-25b3677f0ffd req-312645ad-2784-41a8-8c60-189c48cdace4 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:48.749793 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-577e4d98-13b8-43c0-bcb5-25b3677f0ffd req-312645ad-2784-41a8-8c60-189c48cdace4 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:48.750284 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-577e4d98-13b8-43c0-bcb5-25b3677f0ffd req-312645ad-2784-41a8-8c60-189c48cdace4 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:48.765568 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-577e4d98-13b8-43c0-bcb5-25b3677f0ffd req-312645ad-2784-41a8-8c60-189c48cdace4 service nova] Creating event network-changed:d6f269ef-65e3-4c71-9074-4a4034f13618 for instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 on hv-cinder-83538 Aug 19 15:26:48.770760 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-577e4d98-13b8-43c0-bcb5-25b3677f0ffd req-312645ad-2784-41a8-8c60-189c48cdace4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036651 Aug 19 15:26:48.771493 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 229/444] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:26:50.460229 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5a93f330-b06d-4ab1-ab6e-2f0a55655282 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:26:50.467588 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a93f330-b06d-4ab1-ab6e-2f0a55655282 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:50.468065 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a93f330-b06d-4ab1-ab6e-2f0a55655282 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:50.468523 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a93f330-b06d-4ab1-ab6e-2f0a55655282 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:50.528895 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5a93f330-b06d-4ab1-ab6e-2f0a55655282 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Going to try to stop instance {{(pid=120637) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 19 15:26:50.570242 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5a93f330-b06d-4ab1-ab6e-2f0a55655282 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "POST /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d/action" status: 202 len: 0 microversion: 2.1 time: 0.113647 Aug 19 15:26:50.570852 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 216/445] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Aug 19 15:26:50 2022] POST /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:26:50.580565 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-70c89982-f01a-41f2-8b27-b16192f21b18 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:50.581437 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-70c89982-f01a-41f2-8b27-b16192f21b18 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:50.588812 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70c89982-f01a-41f2-8b27-b16192f21b18 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:50.589647 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70c89982-f01a-41f2-8b27-b16192f21b18 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:50.590298 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70c89982-f01a-41f2-8b27-b16192f21b18 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:50.591074 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70c89982-f01a-41f2-8b27-b16192f21b18 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:50.591568 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70c89982-f01a-41f2-8b27-b16192f21b18 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:50.592082 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70c89982-f01a-41f2-8b27-b16192f21b18 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:50.724841 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-70c89982-f01a-41f2-8b27-b16192f21b18 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:50.732916 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-70c89982-f01a-41f2-8b27-b16192f21b18 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1678 microversion: 2.1 time: 0.157101 Aug 19 15:26:50.733476 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 230/446] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:50 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:51.756314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f752e64b-5e6c-4556-be8a-a57f4bd33a75 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:51.757056 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f752e64b-5e6c-4556-be8a-a57f4bd33a75 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:51.764309 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f752e64b-5e6c-4556-be8a-a57f4bd33a75 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:51.764992 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f752e64b-5e6c-4556-be8a-a57f4bd33a75 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:51.765542 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f752e64b-5e6c-4556-be8a-a57f4bd33a75 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:51.766262 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f752e64b-5e6c-4556-be8a-a57f4bd33a75 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:51.766708 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f752e64b-5e6c-4556-be8a-a57f4bd33a75 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:51.767120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f752e64b-5e6c-4556-be8a-a57f4bd33a75 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:51.904777 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f752e64b-5e6c-4556-be8a-a57f4bd33a75 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:51.912629 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f752e64b-5e6c-4556-be8a-a57f4bd33a75 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1678 microversion: 2.1 time: 0.161039 Aug 19 15:26:51.913196 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 217/447] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:51 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:52.935028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a102cf70-cede-4a8e-a332-0025d525e93f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:52.935613 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a102cf70-cede-4a8e-a332-0025d525e93f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:52.942279 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a102cf70-cede-4a8e-a332-0025d525e93f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:52.942753 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a102cf70-cede-4a8e-a332-0025d525e93f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:52.943178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a102cf70-cede-4a8e-a332-0025d525e93f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:52.943863 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a102cf70-cede-4a8e-a332-0025d525e93f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:52.944308 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a102cf70-cede-4a8e-a332-0025d525e93f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:52.944767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a102cf70-cede-4a8e-a332-0025d525e93f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:53.079639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a102cf70-cede-4a8e-a332-0025d525e93f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:53.087714 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a102cf70-cede-4a8e-a332-0025d525e93f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1678 microversion: 2.1 time: 0.156846 Aug 19 15:26:53.088896 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 231/448] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:52 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:54.110222 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2b5b7f57-6dac-4ab7-9605-429de1b2e0c6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:54.110857 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2b5b7f57-6dac-4ab7-9605-429de1b2e0c6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:54.117400 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b5b7f57-6dac-4ab7-9605-429de1b2e0c6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:54.117870 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b5b7f57-6dac-4ab7-9605-429de1b2e0c6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:54.118309 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b5b7f57-6dac-4ab7-9605-429de1b2e0c6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:54.118967 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b5b7f57-6dac-4ab7-9605-429de1b2e0c6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:54.119405 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b5b7f57-6dac-4ab7-9605-429de1b2e0c6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:54.120501 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b5b7f57-6dac-4ab7-9605-429de1b2e0c6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:54.252049 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b5b7f57-6dac-4ab7-9605-429de1b2e0c6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:54.259944 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2b5b7f57-6dac-4ab7-9605-429de1b2e0c6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1678 microversion: 2.1 time: 0.155097 Aug 19 15:26:54.261865 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 218/449] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:54 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:55.282452 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-50b6333c-8859-4c55-9077-bf55b15b8d65 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:55.283082 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-50b6333c-8859-4c55-9077-bf55b15b8d65 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:55.289895 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50b6333c-8859-4c55-9077-bf55b15b8d65 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:55.290379 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50b6333c-8859-4c55-9077-bf55b15b8d65 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:55.290811 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50b6333c-8859-4c55-9077-bf55b15b8d65 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:55.291509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50b6333c-8859-4c55-9077-bf55b15b8d65 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:55.292621 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50b6333c-8859-4c55-9077-bf55b15b8d65 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:55.293118 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50b6333c-8859-4c55-9077-bf55b15b8d65 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:55.433743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-50b6333c-8859-4c55-9077-bf55b15b8d65 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:55.441471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-50b6333c-8859-4c55-9077-bf55b15b8d65 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1678 microversion: 2.1 time: 0.162902 Aug 19 15:26:55.442037 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 232/450] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:55 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:56.462883 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-800b831a-59f8-4755-95e2-56b236b41476 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:56.463494 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-800b831a-59f8-4755-95e2-56b236b41476 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:56.470145 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-800b831a-59f8-4755-95e2-56b236b41476 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:56.470636 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-800b831a-59f8-4755-95e2-56b236b41476 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:56.471069 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-800b831a-59f8-4755-95e2-56b236b41476 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:56.471750 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-800b831a-59f8-4755-95e2-56b236b41476 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:56.472200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-800b831a-59f8-4755-95e2-56b236b41476 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:56.472649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-800b831a-59f8-4755-95e2-56b236b41476 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:56.603532 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-800b831a-59f8-4755-95e2-56b236b41476 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:56.611511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-800b831a-59f8-4755-95e2-56b236b41476 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1678 microversion: 2.1 time: 0.152472 Aug 19 15:26:56.612081 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 219/451] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:56 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:57.633581 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2583481c-4cb0-459e-ba0f-ab61a4228100 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:57.634415 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2583481c-4cb0-459e-ba0f-ab61a4228100 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:57.641563 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2583481c-4cb0-459e-ba0f-ab61a4228100 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:57.642060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2583481c-4cb0-459e-ba0f-ab61a4228100 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:57.642489 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2583481c-4cb0-459e-ba0f-ab61a4228100 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:57.643188 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2583481c-4cb0-459e-ba0f-ab61a4228100 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:57.643638 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2583481c-4cb0-459e-ba0f-ab61a4228100 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:57.644058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2583481c-4cb0-459e-ba0f-ab61a4228100 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:57.783118 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2583481c-4cb0-459e-ba0f-ab61a4228100 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:57.790937 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2583481c-4cb0-459e-ba0f-ab61a4228100 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1678 microversion: 2.1 time: 0.161299 Aug 19 15:26:57.791511 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 233/452] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:57 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:58.813387 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d52649c6-b1b7-4c88-b71a-aa42b5f137fa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:58.814056 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d52649c6-b1b7-4c88-b71a-aa42b5f137fa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:58.820463 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d52649c6-b1b7-4c88-b71a-aa42b5f137fa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:58.820955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d52649c6-b1b7-4c88-b71a-aa42b5f137fa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:58.821384 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d52649c6-b1b7-4c88-b71a-aa42b5f137fa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:58.822072 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d52649c6-b1b7-4c88-b71a-aa42b5f137fa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:58.822521 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d52649c6-b1b7-4c88-b71a-aa42b5f137fa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:58.822945 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d52649c6-b1b7-4c88-b71a-aa42b5f137fa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:58.956068 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d52649c6-b1b7-4c88-b71a-aa42b5f137fa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:26:58.964557 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d52649c6-b1b7-4c88-b71a-aa42b5f137fa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1678 microversion: 2.1 time: 0.154322 Aug 19 15:26:58.965317 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 220/453] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:58 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:26:59.986152 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ff06e87b-047d-48f3-9890-66264528e73c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:26:59.986765 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ff06e87b-047d-48f3-9890-66264528e73c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:26:59.993328 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff06e87b-047d-48f3-9890-66264528e73c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:59.993844 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff06e87b-047d-48f3-9890-66264528e73c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:59.994283 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff06e87b-047d-48f3-9890-66264528e73c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:26:59.995722 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff06e87b-047d-48f3-9890-66264528e73c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:26:59.996207 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff06e87b-047d-48f3-9890-66264528e73c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:26:59.996543 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff06e87b-047d-48f3-9890-66264528e73c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:00.137132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ff06e87b-047d-48f3-9890-66264528e73c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:00.139470 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:00.147499 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ff06e87b-047d-48f3-9890-66264528e73c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1678 microversion: 2.1 time: 0.165261 Aug 19 15:27:00.148070 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 234/454] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:26:59 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:01.170837 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-82768854-2e90-4ec3-bd54-e3639b1f9670 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:01.171597 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-82768854-2e90-4ec3-bd54-e3639b1f9670 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:01.179558 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82768854-2e90-4ec3-bd54-e3639b1f9670 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:01.180051 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82768854-2e90-4ec3-bd54-e3639b1f9670 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:01.180518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82768854-2e90-4ec3-bd54-e3639b1f9670 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:01.181186 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82768854-2e90-4ec3-bd54-e3639b1f9670 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:01.181681 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82768854-2e90-4ec3-bd54-e3639b1f9670 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:01.182129 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82768854-2e90-4ec3-bd54-e3639b1f9670 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:01.315492 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-82768854-2e90-4ec3-bd54-e3639b1f9670 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:01.324174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-82768854-2e90-4ec3-bd54-e3639b1f9670 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1678 microversion: 2.1 time: 0.157395 Aug 19 15:27:01.324785 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 221/455] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:01 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:01.993507 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-55575218-e9a8-4045-9151-0b434f582437 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:01.994016 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-55575218-e9a8-4045-9151-0b434f582437 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:02.002358 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55575218-e9a8-4045-9151-0b434f582437 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:02.002832 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55575218-e9a8-4045-9151-0b434f582437 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:02.003259 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55575218-e9a8-4045-9151-0b434f582437 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:02.003946 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55575218-e9a8-4045-9151-0b434f582437 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:02.004416 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55575218-e9a8-4045-9151-0b434f582437 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:02.004829 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55575218-e9a8-4045-9151-0b434f582437 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:02.086990 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-55575218-e9a8-4045-9151-0b434f582437 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lazy-loading 'services' on Instance uuid ac205760-e647-4a14-8071-037941d867ce {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:27:02.161429 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-55575218-e9a8-4045-9151-0b434f582437 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce/os-volume_attachments/3a5fe83d-93c7-48b6-b90e-7fe0c8e82abf" status: 202 len: 0 microversion: 2.1 time: 0.171920 Aug 19 15:27:02.162044 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 235/456] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Aug 19 15:27:01 2022] DELETE /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce/os-volume_attachments/3a5fe83d-93c7-48b6-b90e-7fe0c8e82abf => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:27:02.344960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d8f218cc-0b39-4437-82a3-8a901b8abca9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:02.345559 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d8f218cc-0b39-4437-82a3-8a901b8abca9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:02.351960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8f218cc-0b39-4437-82a3-8a901b8abca9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:02.352460 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8f218cc-0b39-4437-82a3-8a901b8abca9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:02.352887 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8f218cc-0b39-4437-82a3-8a901b8abca9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:02.353561 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8f218cc-0b39-4437-82a3-8a901b8abca9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:02.354006 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8f218cc-0b39-4437-82a3-8a901b8abca9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:02.355163 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8f218cc-0b39-4437-82a3-8a901b8abca9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:02.485702 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d8f218cc-0b39-4437-82a3-8a901b8abca9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:02.493344 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d8f218cc-0b39-4437-82a3-8a901b8abca9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1678 microversion: 2.1 time: 0.152221 Aug 19 15:27:02.493901 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 222/457] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:02 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:03.289828 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5041fbfa-bdab-4900-9809-6761cf714cc8 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:03.290406 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5041fbfa-bdab-4900-9809-6761cf714cc8 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:03.297393 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5041fbfa-bdab-4900-9809-6761cf714cc8 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:03.297880 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5041fbfa-bdab-4900-9809-6761cf714cc8 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:03.298313 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5041fbfa-bdab-4900-9809-6761cf714cc8 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:03.299000 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5041fbfa-bdab-4900-9809-6761cf714cc8 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:03.299448 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5041fbfa-bdab-4900-9809-6761cf714cc8 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:03.299869 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5041fbfa-bdab-4900-9809-6761cf714cc8 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:03.325748 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5041fbfa-bdab-4900-9809-6761cf714cc8 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:27:03.406352 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5041fbfa-bdab-4900-9809-6761cf714cc8 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce" status: 204 len: 0 microversion: 2.1 time: 0.120867 Aug 19 15:27:03.406946 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 236/458] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:27:03 2022] DELETE /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:27:03.415872 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ae9c6e9b-af1c-48a6-85a1-20296d818b29 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:03.416584 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ae9c6e9b-af1c-48a6-85a1-20296d818b29 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:03.423306 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae9c6e9b-af1c-48a6-85a1-20296d818b29 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:03.424339 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae9c6e9b-af1c-48a6-85a1-20296d818b29 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:03.424339 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae9c6e9b-af1c-48a6-85a1-20296d818b29 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:03.425003 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae9c6e9b-af1c-48a6-85a1-20296d818b29 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:03.425457 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae9c6e9b-af1c-48a6-85a1-20296d818b29 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:03.425886 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae9c6e9b-af1c-48a6-85a1-20296d818b29 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:03.516324 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8b2c57b3-9c9a-496e-a005-53811f0a29ab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:03.517104 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8b2c57b3-9c9a-496e-a005-53811f0a29ab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:03.523382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b2c57b3-9c9a-496e-a005-53811f0a29ab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:03.523860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b2c57b3-9c9a-496e-a005-53811f0a29ab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:03.524286 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b2c57b3-9c9a-496e-a005-53811f0a29ab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:03.525034 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b2c57b3-9c9a-496e-a005-53811f0a29ab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:03.525457 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b2c57b3-9c9a-496e-a005-53811f0a29ab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:03.525890 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b2c57b3-9c9a-496e-a005-53811f0a29ab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:03.560085 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ae9c6e9b-af1c-48a6-85a1-20296d818b29 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:03.567899 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ae9c6e9b-af1c-48a6-85a1-20296d818b29 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce" status: 200 len: 1515 microversion: 2.1 time: 0.156674 Aug 19 15:27:03.569089 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 223/459] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:03 2022] GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:03.661482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8b2c57b3-9c9a-496e-a005-53811f0a29ab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:03.670184 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8b2c57b3-9c9a-496e-a005-53811f0a29ab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1678 microversion: 2.1 time: 0.158143 Aug 19 15:27:03.671000 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 237/460] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:03 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:27:04.589779 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5b1a1907-2a9f-410c-9b41-96858a1029f5 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:04.590333 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5b1a1907-2a9f-410c-9b41-96858a1029f5 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:04.596378 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b1a1907-2a9f-410c-9b41-96858a1029f5 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:04.596884 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b1a1907-2a9f-410c-9b41-96858a1029f5 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:04.597325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b1a1907-2a9f-410c-9b41-96858a1029f5 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:04.597986 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b1a1907-2a9f-410c-9b41-96858a1029f5 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:04.598433 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b1a1907-2a9f-410c-9b41-96858a1029f5 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:04.598851 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b1a1907-2a9f-410c-9b41-96858a1029f5 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:04.690981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-748187f8-fa4f-4b98-81ee-a13aaa9ecf3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:04.691814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-748187f8-fa4f-4b98-81ee-a13aaa9ecf3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:04.699157 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-748187f8-fa4f-4b98-81ee-a13aaa9ecf3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:04.699751 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-748187f8-fa4f-4b98-81ee-a13aaa9ecf3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:04.700216 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-748187f8-fa4f-4b98-81ee-a13aaa9ecf3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:04.700946 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-748187f8-fa4f-4b98-81ee-a13aaa9ecf3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:04.701408 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-748187f8-fa4f-4b98-81ee-a13aaa9ecf3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:04.702073 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-748187f8-fa4f-4b98-81ee-a13aaa9ecf3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:04.734292 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5b1a1907-2a9f-410c-9b41-96858a1029f5 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:04.742075 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5b1a1907-2a9f-410c-9b41-96858a1029f5 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce" status: 200 len: 1515 microversion: 2.1 time: 0.156297 Aug 19 15:27:04.742650 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 224/461] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:04 2022] GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:04.832091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-748187f8-fa4f-4b98-81ee-a13aaa9ecf3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:04.840546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-748187f8-fa4f-4b98-81ee-a13aaa9ecf3c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1678 microversion: 2.1 time: 0.153396 Aug 19 15:27:04.841054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 238/462] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:04 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:27:05.747124 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-49e2b5b0-575e-4cc4-ac76-54a52ddc2f88 req-7775b2a4-59e4-4280-ab8a-040e67245724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac205760-e647-4a14-8071-037941d867ce", "name": "network-vif-deleted", "tag": "186f45a6-6f25-464c-b4a4-cb2af2dbcb29"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:27:05.759200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-49e2b5b0-575e-4cc4-ac76-54a52ddc2f88 req-7775b2a4-59e4-4280-ab8a-040e67245724 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:05.759781 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-49e2b5b0-575e-4cc4-ac76-54a52ddc2f88 req-7775b2a4-59e4-4280-ab8a-040e67245724 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:05.760348 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-49e2b5b0-575e-4cc4-ac76-54a52ddc2f88 req-7775b2a4-59e4-4280-ab8a-040e67245724 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:05.763754 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-335fe287-b949-4de0-9639-89da603520d9 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:05.764943 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-335fe287-b949-4de0-9639-89da603520d9 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:05.772231 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-335fe287-b949-4de0-9639-89da603520d9 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:05.772749 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-335fe287-b949-4de0-9639-89da603520d9 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:05.773105 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-49e2b5b0-575e-4cc4-ac76-54a52ddc2f88 req-7775b2a4-59e4-4280-ab8a-040e67245724 service nova] Creating event network-vif-deleted:186f45a6-6f25-464c-b4a4-cb2af2dbcb29 for instance ac205760-e647-4a14-8071-037941d867ce on hv-cinder-83538 Aug 19 15:27:05.773233 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-335fe287-b949-4de0-9639-89da603520d9 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:05.773857 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-335fe287-b949-4de0-9639-89da603520d9 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:05.774325 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-335fe287-b949-4de0-9639-89da603520d9 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:05.775457 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-335fe287-b949-4de0-9639-89da603520d9 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:05.778976 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-49e2b5b0-575e-4cc4-ac76-54a52ddc2f88 req-7775b2a4-59e4-4280-ab8a-040e67245724 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036803 Aug 19 15:27:05.779666 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 225/463] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:27:05.846199 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-335fe287-b949-4de0-9639-89da603520d9 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be80a6a93454cd8b7128e976308bd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b848bb5725477b8832057b56c9cf4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:05.854906 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-335fe287-b949-4de0-9639-89da603520d9 tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce" status: 200 len: 1304 microversion: 2.1 time: 0.095314 Aug 19 15:27:05.855709 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 239/464] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:05 2022] GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:05.863014 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3bb7fa3c-6361-436b-a0e1-48b2de7178d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:05.863689 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3bb7fa3c-6361-436b-a0e1-48b2de7178d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:05.870960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bb7fa3c-6361-436b-a0e1-48b2de7178d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:05.871451 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bb7fa3c-6361-436b-a0e1-48b2de7178d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:05.872673 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bb7fa3c-6361-436b-a0e1-48b2de7178d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:05.873380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bb7fa3c-6361-436b-a0e1-48b2de7178d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:05.873817 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bb7fa3c-6361-436b-a0e1-48b2de7178d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:05.874229 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bb7fa3c-6361-436b-a0e1-48b2de7178d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:06.006917 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3bb7fa3c-6361-436b-a0e1-48b2de7178d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:06.015088 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3bb7fa3c-6361-436b-a0e1-48b2de7178d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1678 microversion: 2.1 time: 0.156445 Aug 19 15:27:06.015586 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 226/465] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:05 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:06.875340 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-31d479ab-6519-4bbd-b151-5dde39ba267b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:06.875923 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-31d479ab-6519-4bbd-b151-5dde39ba267b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] [instance: ac205760-e647-4a14-8071-037941d867ce] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:06.882445 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31d479ab-6519-4bbd-b151-5dde39ba267b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:06.882933 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31d479ab-6519-4bbd-b151-5dde39ba267b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:06.883503 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31d479ab-6519-4bbd-b151-5dde39ba267b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:06.884077 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31d479ab-6519-4bbd-b151-5dde39ba267b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:06.884563 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31d479ab-6519-4bbd-b151-5dde39ba267b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:06.884988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31d479ab-6519-4bbd-b151-5dde39ba267b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:06.902160 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-31d479ab-6519-4bbd-b151-5dde39ba267b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] HTTP exception thrown: Instance ac205760-e647-4a14-8071-037941d867ce could not be found. Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-31d479ab-6519-4bbd-b151-5dde39ba267b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Request method failure captured: Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce HTTP/1.1 Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6tKbdbvSNta-CCsiIcU3dyAkMrYyVRkwZ2x4RZBDeKUNQFRccz33hu-Qhjf6UiYmIjA2QLX2k3mAxe5Ab1aizqjMDJKYMI9WCWQ1edO_Uyt1B2z62KxJ8VgTy38LRPRHUTBscvc_HHMWpRX3HVsryE_h3FwM8UPLiDt0Fk9YTJrA3E Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: 42b848bb5725477b8832057b56c9cf4d Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesSnapshotTestJSON-353293627 Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:27:06.904657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:27:06.906232 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_42b848bb5725477b8832057b56c9cf4d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/42b848bb5725477b8832057b56c9cf4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/42b848bb5725477b8832057b56c9cf4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/42b848bb5725477b8832057b56c9cf4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:27:06.906232 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesSnapshotTestJSON-353293627 Aug 19 15:27:06.906232 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 42b848bb5725477b8832057b56c9cf4d Aug 19 15:27:06.906232 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-353293627 Aug 19 15:27:06.906232 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesSnapshotTestJSON-353293627-project Aug 19 15:27:06.906232 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:27:06.906232 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:27:06.906232 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 1be80a6a93454cd8b7128e976308bd4b Aug 19 15:27:06.906232 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesSnapshotTestJSON-353293627-project Aug 19 15:27:06.906232 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:27:06.906232 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance ac205760-e647-4a14-8071-037941d867ce could not be found. Aug 19 15:27:06.906232 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': 'ac205760-e647-4a14-8071-037941d867ce'} Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac205760-e647-4a14-8071-037941d867ce could not be found. Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:27:06.907122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:27:06.908555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:27:06.908555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:27:06.908555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:27:06.908555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:27:06.908555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:27:06.908555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:27:06.908555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:27:06.908555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac205760-e647-4a14-8071-037941d867ce could not be found. Aug 19 15:27:06.908555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:27:06.908555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:27:06.908555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:27:06.908555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:27:06.908555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:27:06.908555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:27:06.908555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:27:06.908555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:27:06.908555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac205760-e647-4a14-8071-037941d867ce could not be found. Aug 19 15:27:06.908555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:27:06.909809 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-31d479ab-6519-4bbd-b151-5dde39ba267b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] Returning 404 to user: Instance ac205760-e647-4a14-8071-037941d867ce could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:27:06.909809 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-31d479ab-6519-4bbd-b151-5dde39ba267b tempest-VolumesSnapshotTestJSON-353293627 tempest-VolumesSnapshotTestJSON-353293627-project] 10.222.0.75 "GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce" status: 404 len: 111 microversion: 2.1 time: 0.034649 Aug 19 15:27:06.909809 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 240/466] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:06 2022] GET /compute/v2.1/servers/ac205760-e647-4a14-8071-037941d867ce => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:27:07.037231 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5680b1a1-9897-455e-853e-9c4bf1346d02 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:07.037985 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5680b1a1-9897-455e-853e-9c4bf1346d02 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:07.046326 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5680b1a1-9897-455e-853e-9c4bf1346d02 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:07.046823 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5680b1a1-9897-455e-853e-9c4bf1346d02 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:07.047261 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5680b1a1-9897-455e-853e-9c4bf1346d02 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:07.048109 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5680b1a1-9897-455e-853e-9c4bf1346d02 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:07.048615 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5680b1a1-9897-455e-853e-9c4bf1346d02 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:07.049205 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5680b1a1-9897-455e-853e-9c4bf1346d02 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:07.229718 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5680b1a1-9897-455e-853e-9c4bf1346d02 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:07.239887 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5680b1a1-9897-455e-853e-9c4bf1346d02 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1678 microversion: 2.1 time: 0.207325 Aug 19 15:27:07.240792 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 227/467] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:07 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:08.263004 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3af1333f-a5e6-4d4a-815b-230103ddb009 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:08.263699 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3af1333f-a5e6-4d4a-815b-230103ddb009 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:08.270349 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3af1333f-a5e6-4d4a-815b-230103ddb009 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:08.270971 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3af1333f-a5e6-4d4a-815b-230103ddb009 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:08.271475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3af1333f-a5e6-4d4a-815b-230103ddb009 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:08.272242 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3af1333f-a5e6-4d4a-815b-230103ddb009 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:08.272864 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3af1333f-a5e6-4d4a-815b-230103ddb009 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:08.273356 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3af1333f-a5e6-4d4a-815b-230103ddb009 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:08.420863 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3af1333f-a5e6-4d4a-815b-230103ddb009 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:08.430105 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3af1333f-a5e6-4d4a-815b-230103ddb009 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1678 microversion: 2.1 time: 0.171788 Aug 19 15:27:08.435524 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 241/468] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:08 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:08.987618 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4a081002-f362-49fb-b15b-89a2e8115b9b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa5eefef-e385-41d6-a000-84c88e4aa67c"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:27:08.989891 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4a081002-f362-49fb-b15b-89a2e8115b9b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:08.996517 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a081002-f362-49fb-b15b-89a2e8115b9b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:08.997008 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a081002-f362-49fb-b15b-89a2e8115b9b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:08.997443 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a081002-f362-49fb-b15b-89a2e8115b9b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:08.998128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a081002-f362-49fb-b15b-89a2e8115b9b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:08.998585 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a081002-f362-49fb-b15b-89a2e8115b9b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:08.999006 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a081002-f362-49fb-b15b-89a2e8115b9b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:09.453174 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5290ce6e-97f7-4321-a89c-fca3b22046ac tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:09.454641 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5290ce6e-97f7-4321-a89c-fca3b22046ac tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:09.457816 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:09.468372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5290ce6e-97f7-4321-a89c-fca3b22046ac tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:09.468372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5290ce6e-97f7-4321-a89c-fca3b22046ac tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:09.468994 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5290ce6e-97f7-4321-a89c-fca3b22046ac tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:09.470183 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5290ce6e-97f7-4321-a89c-fca3b22046ac tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:09.470641 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5290ce6e-97f7-4321-a89c-fca3b22046ac tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:09.471065 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5290ce6e-97f7-4321-a89c-fca3b22046ac tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:09.607608 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5290ce6e-97f7-4321-a89c-fca3b22046ac tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:09.615556 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5290ce6e-97f7-4321-a89c-fca3b22046ac tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1678 microversion: 2.1 time: 0.167939 Aug 19 15:27:09.616119 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 242/469] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:09 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:10.637270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2ffff917-0607-4533-999d-6adf9e81e218 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:10.637903 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2ffff917-0607-4533-999d-6adf9e81e218 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:10.644308 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ffff917-0607-4533-999d-6adf9e81e218 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:10.644819 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ffff917-0607-4533-999d-6adf9e81e218 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:10.645248 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ffff917-0607-4533-999d-6adf9e81e218 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:10.645945 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ffff917-0607-4533-999d-6adf9e81e218 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:10.646402 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ffff917-0607-4533-999d-6adf9e81e218 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:10.646840 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ffff917-0607-4533-999d-6adf9e81e218 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:10.777529 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2ffff917-0607-4533-999d-6adf9e81e218 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:10.785906 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2ffff917-0607-4533-999d-6adf9e81e218 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1678 microversion: 2.1 time: 0.152734 Aug 19 15:27:10.786462 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 243/470] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:10 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:27:11.446827 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:11.469015 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4a081002-f362-49fb-b15b-89a2e8115b9b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "POST /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.485327 Aug 19 15:27:11.469643 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 228/471] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Aug 19 15:27:08 2022] POST /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-volume_attachments => generated 194 bytes in 2487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:27:11.812657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5ed9339e-d00f-4a2d-8e9b-18b881dfb2aa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:11.812657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5ed9339e-d00f-4a2d-8e9b-18b881dfb2aa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:11.814578 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ed9339e-d00f-4a2d-8e9b-18b881dfb2aa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:11.815219 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ed9339e-d00f-4a2d-8e9b-18b881dfb2aa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:11.815648 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ed9339e-d00f-4a2d-8e9b-18b881dfb2aa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:11.824601 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ed9339e-d00f-4a2d-8e9b-18b881dfb2aa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:11.825179 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ed9339e-d00f-4a2d-8e9b-18b881dfb2aa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:11.825624 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ed9339e-d00f-4a2d-8e9b-18b881dfb2aa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:11.969233 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5ed9339e-d00f-4a2d-8e9b-18b881dfb2aa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:11.977030 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5ed9339e-d00f-4a2d-8e9b-18b881dfb2aa tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1655 microversion: 2.1 time: 0.173895 Aug 19 15:27:11.977608 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 244/472] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:11 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1655 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:11.986353 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-827487d3-2103-4802-8157-dd49be263703 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:11.986966 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-827487d3-2103-4802-8157-dd49be263703 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:11.993353 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-827487d3-2103-4802-8157-dd49be263703 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:11.993832 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-827487d3-2103-4802-8157-dd49be263703 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:11.994268 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-827487d3-2103-4802-8157-dd49be263703 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:11.995158 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-827487d3-2103-4802-8157-dd49be263703 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:11.995754 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-827487d3-2103-4802-8157-dd49be263703 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:11.996173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-827487d3-2103-4802-8157-dd49be263703 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:12.001822 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2b00fcda-297e-4166-b528-1f3333406356 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:27:12.008081 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b00fcda-297e-4166-b528-1f3333406356 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:12.008643 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b00fcda-297e-4166-b528-1f3333406356 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:12.009146 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b00fcda-297e-4166-b528-1f3333406356 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:12.021606 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-827487d3-2103-4802-8157-dd49be263703 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27/ips" status: 200 len: 150 microversion: 2.1 time: 0.039781 Aug 19 15:27:12.022162 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 229/473] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Aug 19 15:27:11 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:27:12.035053 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-51b6f1c0-ba6c-4756-95e8-f159b968a0c5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33b41f77-8eb9-4550-9b12-f9ae4a3b49a1"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:27:12.035825 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2b00fcda-297e-4166-b528-1f3333406356 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Going to try to start instance {{(pid=120638) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 19 15:27:12.037565 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-51b6f1c0-ba6c-4756-95e8-f159b968a0c5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:12.043866 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51b6f1c0-ba6c-4756-95e8-f159b968a0c5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:12.044351 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51b6f1c0-ba6c-4756-95e8-f159b968a0c5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:12.044806 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51b6f1c0-ba6c-4756-95e8-f159b968a0c5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:12.045755 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51b6f1c0-ba6c-4756-95e8-f159b968a0c5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:12.046201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51b6f1c0-ba6c-4756-95e8-f159b968a0c5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:12.046618 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51b6f1c0-ba6c-4756-95e8-f159b968a0c5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:12.081781 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2b00fcda-297e-4166-b528-1f3333406356 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "POST /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d/action" status: 202 len: 0 microversion: 2.1 time: 0.083803 Aug 19 15:27:12.082435 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 245/474] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Aug 19 15:27:11 2022] POST /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 19 15:27:12.093780 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-19a27d8b-96c7-4683-b717-f632e561e7c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:12.094574 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-19a27d8b-96c7-4683-b717-f632e561e7c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:12.102185 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19a27d8b-96c7-4683-b717-f632e561e7c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:12.102986 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19a27d8b-96c7-4683-b717-f632e561e7c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:12.104494 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19a27d8b-96c7-4683-b717-f632e561e7c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:12.106246 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19a27d8b-96c7-4683-b717-f632e561e7c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:12.109119 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19a27d8b-96c7-4683-b717-f632e561e7c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:12.109858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19a27d8b-96c7-4683-b717-f632e561e7c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:12.167641 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-51b6f1c0-ba6c-4756-95e8-f159b968a0c5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] HTTP exception thrown: Invalid volume: volume 33b41f77-8eb9-4550-9b12-f9ae4a3b49a1 is already attached to instances: c13d4563-5477-4605-9b1b-85113d779753 Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-51b6f1c0-ba6c-4756-95e8-f159b968a0c5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Request method failure captured: Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: POST /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27/os-volume_attachments HTTP/1.1 Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 74 Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6rjGIu42xaUfT_v0ZhOXSnvehT4QlYhL17z5n_oMEy5IgikNA5uN1BBFVSKHMDsc2O7a9I4Q5QwyQwXQspk3bwkVpeM9P9CWc98yKTuU8FguCcSJbu5xVwv6VOQ4CGubFMZO9oKGHBL5Wx4SbWH4Vr7DIv1aG8W2KhuYrqRW6sHXqA Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:27:12.169386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:27:12.171314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf14c554d854af5ba8cd910c82d42e0", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:27:12.171314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:27:12.171314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:27:12.171314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:27:12.171314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:27:12.171314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:27:12.171314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:27:12.171314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: 4aaa94a183fb49b79e6383ea783ab76d Aug 19 15:27:12.171314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:27:12.171314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Aug 19 15:27:12.171314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {"volumeAttachment": {"volumeId": "33b41f77-8eb9-4550-9b12-f9ae4a3b49a1"}} Aug 19 15:27:12.171314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Invalid volume: volume 33b41f77-8eb9-4550-9b12-f9ae4a3b49a1 is already attached to instances: c13d4563-5477-4605-9b1b-85113d779753 Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'server_id': 'd4717c9f-2cd2-419b-a91c-7f722d99dd27', 'body': {'volumeAttachment': {'volumeId': '33b41f77-8eb9-4550-9b12-f9ae4a3b49a1'}}} Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5119, in attach_volume Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4959, in _check_volume_already_attached Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 33b41f77-8eb9-4550-9b12-f9ae4a3b49a1 is already attached to instances: c13d4563-5477-4605-9b1b-85113d779753 Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:12.176856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 33b41f77-8eb9-4550-9b12-f9ae4a3b49a1 is already attached to instances: c13d4563-5477-4605-9b1b-85113d779753 Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:27:12.178316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:27:12.179516 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:27:12.179516 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:27:12.179516 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:27:12.179516 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 33b41f77-8eb9-4550-9b12-f9ae4a3b49a1 is already attached to instances: c13d4563-5477-4605-9b1b-85113d779753 Aug 19 15:27:12.179516 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:12.179516 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-51b6f1c0-ba6c-4756-95e8-f159b968a0c5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Returning 400 to user: Invalid volume: volume 33b41f77-8eb9-4550-9b12-f9ae4a3b49a1 is already attached to instances: c13d4563-5477-4605-9b1b-85113d779753 {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:27:12.179516 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-51b6f1c0-ba6c-4756-95e8-f159b968a0c5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "POST /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.139826 Aug 19 15:27:12.179516 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 230/475] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Aug 19 15:27:12 2022] POST /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27/os-volume_attachments => generated 174 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 19 15:27:12.185130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b0da1ad-2918-47e7-906f-4e032e29a4bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:12.185740 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b0da1ad-2918-47e7-906f-4e032e29a4bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:12.192626 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b0da1ad-2918-47e7-906f-4e032e29a4bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:12.193232 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b0da1ad-2918-47e7-906f-4e032e29a4bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:12.193760 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b0da1ad-2918-47e7-906f-4e032e29a4bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:12.194563 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b0da1ad-2918-47e7-906f-4e032e29a4bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:12.195111 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b0da1ad-2918-47e7-906f-4e032e29a4bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:12.195624 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b0da1ad-2918-47e7-906f-4e032e29a4bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:12.225750 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b0da1ad-2918-47e7-906f-4e032e29a4bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:27:12.276004 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-19a27d8b-96c7-4683-b717-f632e561e7c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:12.285587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-19a27d8b-96c7-4683-b717-f632e561e7c4 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1664 microversion: 2.1 time: 0.198608 Aug 19 15:27:12.286274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 246/476] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:12 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1664 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:27:12.313134 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b0da1ad-2918-47e7-906f-4e032e29a4bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 204 len: 0 microversion: 2.1 time: 0.131414 Aug 19 15:27:12.314008 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 231/477] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:27:12 2022] DELETE /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:27:12.322230 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7b454ae3-6f93-4025-924a-e994591c6f09 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:12.322905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7b454ae3-6f93-4025-924a-e994591c6f09 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:12.329710 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b454ae3-6f93-4025-924a-e994591c6f09 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:12.330229 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b454ae3-6f93-4025-924a-e994591c6f09 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:12.330677 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b454ae3-6f93-4025-924a-e994591c6f09 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:12.331487 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b454ae3-6f93-4025-924a-e994591c6f09 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:12.331913 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b454ae3-6f93-4025-924a-e994591c6f09 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:12.332341 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b454ae3-6f93-4025-924a-e994591c6f09 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:12.472662 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7b454ae3-6f93-4025-924a-e994591c6f09 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:12.481563 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7b454ae3-6f93-4025-924a-e994591c6f09 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1682 microversion: 2.1 time: 0.163203 Aug 19 15:27:12.482123 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 247/478] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:12 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:13.309520 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d6febebd-6057-4178-b784-1f9abc4f931f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:13.310213 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d6febebd-6057-4178-b784-1f9abc4f931f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:13.317808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6febebd-6057-4178-b784-1f9abc4f931f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:13.318318 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6febebd-6057-4178-b784-1f9abc4f931f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:13.318747 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6febebd-6057-4178-b784-1f9abc4f931f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:13.319459 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6febebd-6057-4178-b784-1f9abc4f931f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:13.319909 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6febebd-6057-4178-b784-1f9abc4f931f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:13.320323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6febebd-6057-4178-b784-1f9abc4f931f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:13.460359 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d6febebd-6057-4178-b784-1f9abc4f931f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:13.468831 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d6febebd-6057-4178-b784-1f9abc4f931f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1664 microversion: 2.1 time: 0.164223 Aug 19 15:27:13.469409 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 232/479] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:13 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:13.502406 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-905ec9ec-6cc3-435f-b1bd-fa10ffc33a69 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:13.502949 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-905ec9ec-6cc3-435f-b1bd-fa10ffc33a69 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:13.509432 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-905ec9ec-6cc3-435f-b1bd-fa10ffc33a69 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:13.509912 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-905ec9ec-6cc3-435f-b1bd-fa10ffc33a69 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:13.511001 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-905ec9ec-6cc3-435f-b1bd-fa10ffc33a69 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:13.511705 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-905ec9ec-6cc3-435f-b1bd-fa10ffc33a69 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:13.512155 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-905ec9ec-6cc3-435f-b1bd-fa10ffc33a69 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:13.512610 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-905ec9ec-6cc3-435f-b1bd-fa10ffc33a69 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:13.651324 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-905ec9ec-6cc3-435f-b1bd-fa10ffc33a69 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:13.654345 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:13.663771 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-905ec9ec-6cc3-435f-b1bd-fa10ffc33a69 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1682 microversion: 2.1 time: 0.165261 Aug 19 15:27:13.664362 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 248/480] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:13 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:14.490657 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9db80577-128f-44b6-a1b2-2de606438981 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:14.491257 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9db80577-128f-44b6-a1b2-2de606438981 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:14.499337 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9db80577-128f-44b6-a1b2-2de606438981 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:14.499826 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9db80577-128f-44b6-a1b2-2de606438981 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:14.500258 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9db80577-128f-44b6-a1b2-2de606438981 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:14.501006 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9db80577-128f-44b6-a1b2-2de606438981 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:14.501455 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9db80577-128f-44b6-a1b2-2de606438981 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:14.501900 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9db80577-128f-44b6-a1b2-2de606438981 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:14.653350 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9db80577-128f-44b6-a1b2-2de606438981 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:14.663871 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9db80577-128f-44b6-a1b2-2de606438981 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1664 microversion: 2.1 time: 0.176139 Aug 19 15:27:14.676433 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 233/481] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:14 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1664 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:14.686558 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-36e5b913-5add-4a28-b744-ebeb69c34402 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:14.687304 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-36e5b913-5add-4a28-b744-ebeb69c34402 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:14.695946 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36e5b913-5add-4a28-b744-ebeb69c34402 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:14.696465 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36e5b913-5add-4a28-b744-ebeb69c34402 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:14.697515 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36e5b913-5add-4a28-b744-ebeb69c34402 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:14.698266 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36e5b913-5add-4a28-b744-ebeb69c34402 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:14.698719 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36e5b913-5add-4a28-b744-ebeb69c34402 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:14.699344 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36e5b913-5add-4a28-b744-ebeb69c34402 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:14.784684 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-36e5b913-5add-4a28-b744-ebeb69c34402 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:14.793252 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-36e5b913-5add-4a28-b744-ebeb69c34402 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 200 len: 1614 microversion: 2.1 time: 0.111554 Aug 19 15:27:14.793827 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 249/482] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:14 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 1614 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:15.063650 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-210309fa-7e1c-4012-b0a6-7a0df9244419 req-96558bfc-6caf-476d-9109-5526d07992cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4717c9f-2cd2-419b-a91c-7f722d99dd27", "name": "network-vif-deleted", "tag": "789e4df0-1af5-4f96-9194-ab12ac1b5047"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:27:15.079413 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-210309fa-7e1c-4012-b0a6-7a0df9244419 req-96558bfc-6caf-476d-9109-5526d07992cf service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:15.080113 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-210309fa-7e1c-4012-b0a6-7a0df9244419 req-96558bfc-6caf-476d-9109-5526d07992cf service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:15.080849 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-210309fa-7e1c-4012-b0a6-7a0df9244419 req-96558bfc-6caf-476d-9109-5526d07992cf service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:15.099355 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-210309fa-7e1c-4012-b0a6-7a0df9244419 req-96558bfc-6caf-476d-9109-5526d07992cf service nova] Creating event network-vif-deleted:789e4df0-1af5-4f96-9194-ab12ac1b5047 for instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 on hv-cinder-83538 Aug 19 15:27:15.108610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-210309fa-7e1c-4012-b0a6-7a0df9244419 req-96558bfc-6caf-476d-9109-5526d07992cf service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049930 Aug 19 15:27:15.109502 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 234/483] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:27:15.688715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-96cca603-9553-4ca3-b588-cabcc9ab67af tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:15.689498 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-96cca603-9553-4ca3-b588-cabcc9ab67af tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:15.702684 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96cca603-9553-4ca3-b588-cabcc9ab67af tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:15.704308 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96cca603-9553-4ca3-b588-cabcc9ab67af tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:15.705014 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96cca603-9553-4ca3-b588-cabcc9ab67af tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:15.709250 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96cca603-9553-4ca3-b588-cabcc9ab67af tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:15.711039 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96cca603-9553-4ca3-b588-cabcc9ab67af tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:15.712521 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96cca603-9553-4ca3-b588-cabcc9ab67af tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:15.816817 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cefc7186-ad08-4760-939e-b64d683b1411 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:15.817775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cefc7186-ad08-4760-939e-b64d683b1411 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:15.832785 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cefc7186-ad08-4760-939e-b64d683b1411 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:15.833438 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cefc7186-ad08-4760-939e-b64d683b1411 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:15.833979 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cefc7186-ad08-4760-939e-b64d683b1411 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:15.834821 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cefc7186-ad08-4760-939e-b64d683b1411 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:15.835533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cefc7186-ad08-4760-939e-b64d683b1411 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:15.836203 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cefc7186-ad08-4760-939e-b64d683b1411 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:15.864184 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-cefc7186-ad08-4760-939e-b64d683b1411 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] HTTP exception thrown: Instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 could not be found. Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cefc7186-ad08-4760-939e-b64d683b1411 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Request method failure captured: Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 HTTP/1.1 Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6rjGIu42xaUfT_v0ZhOXSnvehT4QlYhL17z5n_oMEy5IgikNA5uN1BBFVSKHMDsc2O7a9I4Q5QwyQwXQspk3bwkVpeM9P9CWc98yKTuU8FguCcSJbu5xVwv6VOQ4CGubFMZO9oKGHBL5Wx4SbWH4Vr7DIv1aG8W2KhuYrqRW6sHXqA Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:27:15.866228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:27:15.868091 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf14c554d854af5ba8cd910c82d42e0", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:27:15.868091 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:27:15.868091 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:27:15.868091 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:27:15.868091 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:27:15.868091 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:27:15.868091 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:27:15.868091 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: 4aaa94a183fb49b79e6383ea783ab76d Aug 19 15:27:15.868091 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:27:15.868091 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:27:15.868091 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 could not be found. Aug 19 15:27:15.868091 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': 'd4717c9f-2cd2-419b-a91c-7f722d99dd27'} Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 could not be found. Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:27:15.869076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:27:15.870610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:27:15.870610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:27:15.870610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:27:15.870610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:27:15.870610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:27:15.870610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:27:15.870610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:27:15.870610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 could not be found. Aug 19 15:27:15.870610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:15.870610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:27:15.870610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:15.870610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:27:15.870610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:27:15.870610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:27:15.870610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:27:15.870610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:27:15.870610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 could not be found. Aug 19 15:27:15.870610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:15.873109 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cefc7186-ad08-4760-939e-b64d683b1411 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Returning 404 to user: Instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:27:15.874277 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cefc7186-ad08-4760-939e-b64d683b1411 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 404 len: 111 microversion: 2.1 time: 0.063130 Aug 19 15:27:15.874992 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 235/484] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:15 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:27:15.884830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2e33a551-c231-4f78-8d18-10946424b442 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '.version_select at 0x7fb5333d4a60>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:15.924948 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2e33a551-c231-4f78-8d18-10946424b442 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1366970379" status: 202 len: 0 microversion: 2.1 time: 0.042706 Aug 19 15:27:15.930984 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 236/485] 10.222.0.75 () {58 vars in 1221 bytes} [Fri Aug 19 15:27:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1366970379 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:27:15.942255 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-96cca603-9553-4ca3-b588-cabcc9ab67af tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:15.952531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-96cca603-9553-4ca3-b588-cabcc9ab67af tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1668 microversion: 2.1 time: 0.268002 Aug 19 15:27:15.953622 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 250/486] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:15 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1668 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:16.714816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2c3c497b-716a-4bd6-a6af-c0713e766cb6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:16.715337 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2c3c497b-716a-4bd6-a6af-c0713e766cb6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:16.717267 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:16.723415 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c3c497b-716a-4bd6-a6af-c0713e766cb6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:16.723847 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c3c497b-716a-4bd6-a6af-c0713e766cb6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:16.724268 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c3c497b-716a-4bd6-a6af-c0713e766cb6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:16.724969 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c3c497b-716a-4bd6-a6af-c0713e766cb6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:16.725434 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c3c497b-716a-4bd6-a6af-c0713e766cb6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:16.725886 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c3c497b-716a-4bd6-a6af-c0713e766cb6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:16.811617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-2c3c497b-716a-4bd6-a6af-c0713e766cb6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lazy-loading 'services' on Instance uuid c13d4563-5477-4605-9b1b-85113d779753 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:27:16.892553 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2c3c497b-716a-4bd6-a6af-c0713e766cb6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753/os-volume_attachments/33b41f77-8eb9-4550-9b12-f9ae4a3b49a1" status: 202 len: 0 microversion: 2.1 time: 0.181575 Aug 19 15:27:16.895243 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 237/487] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Aug 19 15:27:16 2022] DELETE /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753/os-volume_attachments/33b41f77-8eb9-4550-9b12-f9ae4a3b49a1 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:27:16.902736 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aa4be5ad-fa50-4aa1-b516-d973f2b6324e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:16.905022 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aa4be5ad-fa50-4aa1-b516-d973f2b6324e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:16.911743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa4be5ad-fa50-4aa1-b516-d973f2b6324e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:16.912225 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa4be5ad-fa50-4aa1-b516-d973f2b6324e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:16.912698 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa4be5ad-fa50-4aa1-b516-d973f2b6324e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:16.913576 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa4be5ad-fa50-4aa1-b516-d973f2b6324e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:16.914190 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa4be5ad-fa50-4aa1-b516-d973f2b6324e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:16.914609 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa4be5ad-fa50-4aa1-b516-d973f2b6324e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:16.944929 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aa4be5ad-fa50-4aa1-b516-d973f2b6324e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047048 Aug 19 15:27:16.945480 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 251/488] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:27:16 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:27:17.958961 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-456d7478-ff3d-42dc-8db0-fc2c0f4ec72b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:17.961280 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-456d7478-ff3d-42dc-8db0-fc2c0f4ec72b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:17.968670 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-456d7478-ff3d-42dc-8db0-fc2c0f4ec72b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:17.969164 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-456d7478-ff3d-42dc-8db0-fc2c0f4ec72b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:17.969569 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-456d7478-ff3d-42dc-8db0-fc2c0f4ec72b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:17.970248 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-456d7478-ff3d-42dc-8db0-fc2c0f4ec72b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:17.970689 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-456d7478-ff3d-42dc-8db0-fc2c0f4ec72b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:17.971099 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-456d7478-ff3d-42dc-8db0-fc2c0f4ec72b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:18.003614 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-456d7478-ff3d-42dc-8db0-fc2c0f4ec72b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049346 Aug 19 15:27:18.004183 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 238/489] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:27:17 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:27:19.015535 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8f9122e5-419c-460a-8ba2-a088fe9f6ff9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:19.017647 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8f9122e5-419c-460a-8ba2-a088fe9f6ff9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:19.024174 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f9122e5-419c-460a-8ba2-a088fe9f6ff9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:19.024699 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f9122e5-419c-460a-8ba2-a088fe9f6ff9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:19.025137 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f9122e5-419c-460a-8ba2-a088fe9f6ff9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:19.025830 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f9122e5-419c-460a-8ba2-a088fe9f6ff9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:19.026288 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f9122e5-419c-460a-8ba2-a088fe9f6ff9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:19.026710 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f9122e5-419c-460a-8ba2-a088fe9f6ff9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:19.060251 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8f9122e5-419c-460a-8ba2-a088fe9f6ff9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048862 Aug 19 15:27:19.060884 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 252/490] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:27:19 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:27:20.073406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e713f83b-3a39-461c-9b02-f98a4517542f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:20.076826 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e713f83b-3a39-461c-9b02-f98a4517542f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:20.090216 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e713f83b-3a39-461c-9b02-f98a4517542f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:20.090753 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e713f83b-3a39-461c-9b02-f98a4517542f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:20.094487 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e713f83b-3a39-461c-9b02-f98a4517542f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:20.095391 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e713f83b-3a39-461c-9b02-f98a4517542f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:20.098483 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e713f83b-3a39-461c-9b02-f98a4517542f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:20.099099 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e713f83b-3a39-461c-9b02-f98a4517542f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:20.154934 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e713f83b-3a39-461c-9b02-f98a4517542f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086096 Aug 19 15:27:20.159684 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 239/491] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:27:20 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:27:20.159849 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8e83a33d-4ca2-4e54-bfe8-17ba98b3e07e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:27:20.160561 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8e83a33d-4ca2-4e54-bfe8-17ba98b3e07e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:20.167799 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e83a33d-4ca2-4e54-bfe8-17ba98b3e07e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:20.168898 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e83a33d-4ca2-4e54-bfe8-17ba98b3e07e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:20.169561 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e83a33d-4ca2-4e54-bfe8-17ba98b3e07e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:20.171006 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e83a33d-4ca2-4e54-bfe8-17ba98b3e07e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:20.171400 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e83a33d-4ca2-4e54-bfe8-17ba98b3e07e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:20.171882 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e83a33d-4ca2-4e54-bfe8-17ba98b3e07e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:20.200723 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-8e83a33d-4ca2-4e54-bfe8-17ba98b3e07e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lazy-loading 'flavor' on Instance uuid c73df7a2-f347-4f80-8853-f5ea25b0cbc7 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:27:20.338291 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8e83a33d-4ca2-4e54-bfe8-17ba98b3e07e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "POST /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/action" status: 200 len: 32 microversion: 2.1 time: 0.190668 Aug 19 15:27:20.344057 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 253/492] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Aug 19 15:27:20 2022] POST /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 15:27:20.349492 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ca3427c3-5ac6-4312-aefd-62fd6ef82627 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:20.350154 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ca3427c3-5ac6-4312-aefd-62fd6ef82627 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:20.357331 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca3427c3-5ac6-4312-aefd-62fd6ef82627 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:20.358189 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca3427c3-5ac6-4312-aefd-62fd6ef82627 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:20.358666 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca3427c3-5ac6-4312-aefd-62fd6ef82627 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:20.359818 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca3427c3-5ac6-4312-aefd-62fd6ef82627 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:20.360311 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca3427c3-5ac6-4312-aefd-62fd6ef82627 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:20.360810 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca3427c3-5ac6-4312-aefd-62fd6ef82627 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:20.500691 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ca3427c3-5ac6-4312-aefd-62fd6ef82627 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:20.509196 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ca3427c3-5ac6-4312-aefd-62fd6ef82627 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.163818 Aug 19 15:27:20.509837 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 240/493] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:20 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:21.168166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-73000600-8818-4ade-8bc1-e4a087e43b1d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:21.170505 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-73000600-8818-4ade-8bc1-e4a087e43b1d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:21.177574 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73000600-8818-4ade-8bc1-e4a087e43b1d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:21.178060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73000600-8818-4ade-8bc1-e4a087e43b1d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:21.179223 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73000600-8818-4ade-8bc1-e4a087e43b1d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:21.180096 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73000600-8818-4ade-8bc1-e4a087e43b1d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:21.180593 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73000600-8818-4ade-8bc1-e4a087e43b1d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:21.181021 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73000600-8818-4ade-8bc1-e4a087e43b1d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:21.215407 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-73000600-8818-4ade-8bc1-e4a087e43b1d tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051511 Aug 19 15:27:21.216424 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 254/494] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:27:21 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 15:27:21.291289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e49c70d5-71f6-4866-80d5-73338a7bdc27 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:21.291916 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e49c70d5-71f6-4866-80d5-73338a7bdc27 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:21.299640 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e49c70d5-71f6-4866-80d5-73338a7bdc27 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:21.300261 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e49c70d5-71f6-4866-80d5-73338a7bdc27 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:21.300806 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e49c70d5-71f6-4866-80d5-73338a7bdc27 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:21.301567 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e49c70d5-71f6-4866-80d5-73338a7bdc27 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:21.302119 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e49c70d5-71f6-4866-80d5-73338a7bdc27 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:21.302663 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e49c70d5-71f6-4866-80d5-73338a7bdc27 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:21.335139 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e49c70d5-71f6-4866-80d5-73338a7bdc27 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:27:21.440636 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e49c70d5-71f6-4866-80d5-73338a7bdc27 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 204 len: 0 microversion: 2.1 time: 0.152868 Aug 19 15:27:21.441741 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 241/495] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:27:21 2022] DELETE /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:27:21.453652 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e149660a-0b86-4423-8edd-d51765b7db04 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:21.455376 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e149660a-0b86-4423-8edd-d51765b7db04 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:21.465074 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e149660a-0b86-4423-8edd-d51765b7db04 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:21.465678 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e149660a-0b86-4423-8edd-d51765b7db04 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:21.466255 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e149660a-0b86-4423-8edd-d51765b7db04 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:21.467066 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e149660a-0b86-4423-8edd-d51765b7db04 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:21.467773 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e149660a-0b86-4423-8edd-d51765b7db04 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:21.468465 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e149660a-0b86-4423-8edd-d51765b7db04 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:21.532664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d3a32634-02f3-4b5a-9506-a45e1208593b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:21.533425 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d3a32634-02f3-4b5a-9506-a45e1208593b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:21.541300 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3a32634-02f3-4b5a-9506-a45e1208593b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:21.541915 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3a32634-02f3-4b5a-9506-a45e1208593b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:21.542553 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3a32634-02f3-4b5a-9506-a45e1208593b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:21.543443 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3a32634-02f3-4b5a-9506-a45e1208593b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:21.544016 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3a32634-02f3-4b5a-9506-a45e1208593b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:21.544762 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3a32634-02f3-4b5a-9506-a45e1208593b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:21.659582 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e149660a-0b86-4423-8edd-d51765b7db04 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:21.676107 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e149660a-0b86-4423-8edd-d51765b7db04 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1682 microversion: 2.1 time: 0.228003 Aug 19 15:27:21.677147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 255/496] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:21 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1682 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:21.719202 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d3a32634-02f3-4b5a-9506-a45e1208593b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:21.732251 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d3a32634-02f3-4b5a-9506-a45e1208593b tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.204616 Aug 19 15:27:21.732938 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 242/497] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:21 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:27:22.699152 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4e3b9aaf-9266-4914-9e9d-5049ac429688 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:22.699763 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4e3b9aaf-9266-4914-9e9d-5049ac429688 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:22.707706 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e3b9aaf-9266-4914-9e9d-5049ac429688 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:22.708198 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e3b9aaf-9266-4914-9e9d-5049ac429688 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:22.708674 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e3b9aaf-9266-4914-9e9d-5049ac429688 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:22.709373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e3b9aaf-9266-4914-9e9d-5049ac429688 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:22.709830 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e3b9aaf-9266-4914-9e9d-5049ac429688 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:22.710251 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e3b9aaf-9266-4914-9e9d-5049ac429688 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:22.758064 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8280b9e5-94a5-4c62-9fb5-efe0e8a707f3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:22.758958 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8280b9e5-94a5-4c62-9fb5-efe0e8a707f3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:22.766962 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8280b9e5-94a5-4c62-9fb5-efe0e8a707f3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:22.767550 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8280b9e5-94a5-4c62-9fb5-efe0e8a707f3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:22.768084 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8280b9e5-94a5-4c62-9fb5-efe0e8a707f3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:22.768908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8280b9e5-94a5-4c62-9fb5-efe0e8a707f3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:22.769456 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8280b9e5-94a5-4c62-9fb5-efe0e8a707f3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:22.769975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8280b9e5-94a5-4c62-9fb5-efe0e8a707f3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:22.791003 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=93,nova_cell1:INSERT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:22.898960 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4e3b9aaf-9266-4914-9e9d-5049ac429688 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:22.907927 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4e3b9aaf-9266-4914-9e9d-5049ac429688 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1682 microversion: 2.1 time: 0.212921 Aug 19 15:27:22.908523 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 256/498] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:22 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:22.947015 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8280b9e5-94a5-4c62-9fb5-efe0e8a707f3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:22.957527 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8280b9e5-94a5-4c62-9fb5-efe0e8a707f3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.203557 Aug 19 15:27:22.958106 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 243/499] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:22 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:23.929238 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9a512c53-dcab-40e2-85fc-03c2b370508e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:23.929856 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9a512c53-dcab-40e2-85fc-03c2b370508e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:23.936929 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a512c53-dcab-40e2-85fc-03c2b370508e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:23.937435 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a512c53-dcab-40e2-85fc-03c2b370508e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:23.937962 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a512c53-dcab-40e2-85fc-03c2b370508e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:23.938667 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a512c53-dcab-40e2-85fc-03c2b370508e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:23.939117 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a512c53-dcab-40e2-85fc-03c2b370508e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:23.939538 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a512c53-dcab-40e2-85fc-03c2b370508e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:23.981827 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-01f10673-c979-4f79-9f2b-eb7bd48ab647 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:23.983107 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-01f10673-c979-4f79-9f2b-eb7bd48ab647 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:23.990466 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01f10673-c979-4f79-9f2b-eb7bd48ab647 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:23.991072 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01f10673-c979-4f79-9f2b-eb7bd48ab647 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:23.991601 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01f10673-c979-4f79-9f2b-eb7bd48ab647 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:23.992737 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01f10673-c979-4f79-9f2b-eb7bd48ab647 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:23.993360 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01f10673-c979-4f79-9f2b-eb7bd48ab647 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:23.993831 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01f10673-c979-4f79-9f2b-eb7bd48ab647 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:24.011545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9a512c53-dcab-40e2-85fc-03c2b370508e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:24.020061 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9a512c53-dcab-40e2-85fc-03c2b370508e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 200 len: 1615 microversion: 2.1 time: 0.094459 Aug 19 15:27:24.020668 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 257/500] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:23 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 1615 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:24.151475 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-01f10673-c979-4f79-9f2b-eb7bd48ab647 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:24.161393 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-01f10673-c979-4f79-9f2b-eb7bd48ab647 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.184308 Aug 19 15:27:24.162088 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 244/501] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:23 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:24.181080 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-8271d4cc-6df3-49cd-bead-4989d915164b req-3123e92e-7ecf-443c-b3c3-745192839fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13d4563-5477-4605-9b1b-85113d779753", "name": "network-vif-deleted", "tag": "02304f9d-f8e5-4fc7-8c86-f4b23da124da"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:27:24.191370 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-8271d4cc-6df3-49cd-bead-4989d915164b req-3123e92e-7ecf-443c-b3c3-745192839fc1 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:24.191852 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-8271d4cc-6df3-49cd-bead-4989d915164b req-3123e92e-7ecf-443c-b3c3-745192839fc1 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:24.192312 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-8271d4cc-6df3-49cd-bead-4989d915164b req-3123e92e-7ecf-443c-b3c3-745192839fc1 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:24.208489 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-8271d4cc-6df3-49cd-bead-4989d915164b req-3123e92e-7ecf-443c-b3c3-745192839fc1 service nova] Creating event network-vif-deleted:02304f9d-f8e5-4fc7-8c86-f4b23da124da for instance c13d4563-5477-4605-9b1b-85113d779753 on hv-cinder-83538 Aug 19 15:27:24.216770 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-8271d4cc-6df3-49cd-bead-4989d915164b req-3123e92e-7ecf-443c-b3c3-745192839fc1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037749 Aug 19 15:27:24.217717 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 258/502] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:27:25.043282 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-506c28eb-b5c6-464d-b523-e1db9dacde3f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:25.044052 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-506c28eb-b5c6-464d-b523-e1db9dacde3f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:25.050525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-506c28eb-b5c6-464d-b523-e1db9dacde3f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:25.051106 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-506c28eb-b5c6-464d-b523-e1db9dacde3f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:25.051603 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-506c28eb-b5c6-464d-b523-e1db9dacde3f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:25.052681 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-506c28eb-b5c6-464d-b523-e1db9dacde3f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:25.053218 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-506c28eb-b5c6-464d-b523-e1db9dacde3f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:25.053814 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-506c28eb-b5c6-464d-b523-e1db9dacde3f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:25.074643 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-506c28eb-b5c6-464d-b523-e1db9dacde3f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] HTTP exception thrown: Instance c13d4563-5477-4605-9b1b-85113d779753 could not be found. Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-506c28eb-b5c6-464d-b523-e1db9dacde3f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Request method failure captured: Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 HTTP/1.1 Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6rjGIu42xaUfT_v0ZhOXSnvehT4QlYhL17z5n_oMEy5IgikNA5uN1BBFVSKHMDsc2O7a9I4Q5QwyQwXQspk3bwkVpeM9P9CWc98yKTuU8FguCcSJbu5xVwv6VOQ4CGubFMZO9oKGHBL5Wx4SbWH4Vr7DIv1aG8W2KhuYrqRW6sHXqA Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:27:25.076274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:27:25.078352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf14c554d854af5ba8cd910c82d42e0", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:27:25.078352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:27:25.078352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:27:25.078352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:27:25.078352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:27:25.078352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:27:25.078352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:27:25.078352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: 4aaa94a183fb49b79e6383ea783ab76d Aug 19 15:27:25.078352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:27:25.078352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:27:25.078352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Instance c13d4563-5477-4605-9b1b-85113d779753 could not be found. Aug 19 15:27:25.078352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': 'c13d4563-5477-4605-9b1b-85113d779753'} Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c13d4563-5477-4605-9b1b-85113d779753 could not be found. Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:27:25.079411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:27:25.080908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:27:25.080908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:27:25.080908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:27:25.080908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:27:25.080908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:27:25.080908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:27:25.080908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:27:25.080908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c13d4563-5477-4605-9b1b-85113d779753 could not be found. Aug 19 15:27:25.080908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:25.080908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:27:25.080908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:25.080908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:27:25.080908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:27:25.080908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:27:25.080908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:27:25.080908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:27:25.080908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c13d4563-5477-4605-9b1b-85113d779753 could not be found. Aug 19 15:27:25.080908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:25.082241 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-506c28eb-b5c6-464d-b523-e1db9dacde3f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Returning 404 to user: Instance c13d4563-5477-4605-9b1b-85113d779753 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:27:25.082241 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-506c28eb-b5c6-464d-b523-e1db9dacde3f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 404 len: 111 microversion: 2.1 time: 0.039977 Aug 19 15:27:25.082241 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 245/503] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:25 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:27:25.089460 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a0f19ec0-1a0e-45b6-a604-3e5c4463c12b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '.version_select at 0x7fb5333bfdc0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:25.116228 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a0f19ec0-1a0e-45b6-a604-3e5c4463c12b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1566286012" status: 202 len: 0 microversion: 2.1 time: 0.032346 Aug 19 15:27:25.116869 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 259/504] 10.222.0.75 () {58 vars in 1221 bytes} [Fri Aug 19 15:27:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1566286012 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:27:25.187980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c7bf6ec3-03f1-4a57-bd49-da4564b322cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:25.192083 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c7bf6ec3-03f1-4a57-bd49-da4564b322cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:25.198367 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7bf6ec3-03f1-4a57-bd49-da4564b322cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:25.198845 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7bf6ec3-03f1-4a57-bd49-da4564b322cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:25.199272 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7bf6ec3-03f1-4a57-bd49-da4564b322cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:25.200140 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7bf6ec3-03f1-4a57-bd49-da4564b322cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:25.200623 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7bf6ec3-03f1-4a57-bd49-da4564b322cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:25.201199 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7bf6ec3-03f1-4a57-bd49-da4564b322cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:25.368904 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c7bf6ec3-03f1-4a57-bd49-da4564b322cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:25.378609 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c7bf6ec3-03f1-4a57-bd49-da4564b322cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.199172 Aug 19 15:27:25.379251 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 246/505] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:25 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:25.844639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0aaac60c-43d5-4701-8f88-45dd1649a3de tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Action: 'create', calling method: .version_select at 0x7fb533300790>, body: {"keypair": {"name": "tempest-keypair-465619978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkAX8EdpaVn/yoW7xQmtmWL6DGzNNRE7Y6uPoqTk143aF0UKgdWPb096NyGKb+CCkNR1HmcLSy5p/zvth+UEJYpODgslCfHEth+XL+k6YDjsdTeeFuctY73XhY18wNqkQ=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:27:25.860673 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-0aaac60c-43d5-4701-8f88-45dd1649a3de tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Getting quotas for project cbf14c554d854af5ba8cd910c82d42e0. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:27:25.864699 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-0aaac60c-43d5-4701-8f88-45dd1649a3de tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Getting quotas for user 4aaa94a183fb49b79e6383ea783ab76d and project cbf14c554d854af5ba8cd910c82d42e0. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:27:25.888911 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0aaac60c-43d5-4701-8f88-45dd1649a3de tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048143 Aug 19 15:27:25.889515 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 260/506] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Aug 19 15:27:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:27:26.399622 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e4c9265a-c04a-4548-a6a7-63a6663bb4d7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:26.400277 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e4c9265a-c04a-4548-a6a7-63a6663bb4d7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:26.407496 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4c9265a-c04a-4548-a6a7-63a6663bb4d7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:26.408196 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4c9265a-c04a-4548-a6a7-63a6663bb4d7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:26.408843 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4c9265a-c04a-4548-a6a7-63a6663bb4d7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:26.409537 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4c9265a-c04a-4548-a6a7-63a6663bb4d7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:26.409984 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4c9265a-c04a-4548-a6a7-63a6663bb4d7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:26.410506 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4c9265a-c04a-4548-a6a7-63a6663bb4d7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:26.619936 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e4c9265a-c04a-4548-a6a7-63a6663bb4d7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:26.628414 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e4c9265a-c04a-4548-a6a7-63a6663bb4d7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.232855 Aug 19 15:27:26.629000 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 247/507] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:26 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:27.330253 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d2be5810-645e-43ef-9b71-c5eb621223cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1992377283", "imageRef": "27174b76-85e7-4123-a2bc-847959ca59f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a74f9df-bea0-4bc2-8022-d4f3c9598ba3"}], "security_groups": [{"name": "tempest-securitygroup--2104771934"}], "key_name": "tempest-keypair-465619978", "user_data": "}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:27:27.652312 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b54170bb-9605-492b-9258-6f19586055cf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:27.653084 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b54170bb-9605-492b-9258-6f19586055cf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:27.661370 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b54170bb-9605-492b-9258-6f19586055cf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:27.662026 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b54170bb-9605-492b-9258-6f19586055cf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:27.662560 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b54170bb-9605-492b-9258-6f19586055cf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:27.663392 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b54170bb-9605-492b-9258-6f19586055cf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:27.663981 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b54170bb-9605-492b-9258-6f19586055cf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:27.664759 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b54170bb-9605-492b-9258-6f19586055cf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:27.666202 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-d2be5810-645e-43ef-9b71-c5eb621223cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] validate_networks() for [('6a74f9df-bea0-4bc2-8022-d4f3c9598ba3', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:27:27.896501 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b54170bb-9605-492b-9258-6f19586055cf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:27.905697 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b54170bb-9605-492b-9258-6f19586055cf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.258721 Aug 19 15:27:27.906369 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 248/508] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:27 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:28.148306 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-d2be5810-645e-43ef-9b71-c5eb621223cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:27:28.148752 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-d2be5810-645e-43ef-9b71-c5eb621223cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:27:28.149243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-d2be5810-645e-43ef-9b71-c5eb621223cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:27:28.149646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-d2be5810-645e-43ef-9b71-c5eb621223cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:27:28.150048 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-d2be5810-645e-43ef-9b71-c5eb621223cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:27:28.159774 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2be5810-645e-43ef-9b71-c5eb621223cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:28.160246 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2be5810-645e-43ef-9b71-c5eb621223cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:28.160702 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2be5810-645e-43ef-9b71-c5eb621223cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:28.161417 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2be5810-645e-43ef-9b71-c5eb621223cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:28.161860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2be5810-645e-43ef-9b71-c5eb621223cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:28.162307 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2be5810-645e-43ef-9b71-c5eb621223cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:28.180530 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-d2be5810-645e-43ef-9b71-c5eb621223cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Getting quotas for project cbf14c554d854af5ba8cd910c82d42e0. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:27:28.184824 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-d2be5810-645e-43ef-9b71-c5eb621223cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Getting quotas for user 4aaa94a183fb49b79e6383ea783ab76d and project cbf14c554d854af5ba8cd910c82d42e0. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:27:28.195709 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d2be5810-645e-43ef-9b71-c5eb621223cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:27:28.198488 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d2be5810-645e-43ef-9b71-c5eb621223cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27174b76-85e7-4123-a2bc-847959ca59f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:27:28.246215 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d2be5810-645e-43ef-9b71-c5eb621223cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.920583 Aug 19 15:27:28.246859 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 261/509] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:27:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 19 15:27:28.258181 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dfd75e73-3e3e-4e02-85a3-d5c890836c43 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:28.258871 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dfd75e73-3e3e-4e02-85a3-d5c890836c43 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:28.320434 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dfd75e73-3e3e-4e02-85a3-d5c890836c43 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:28.331731 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dfd75e73-3e3e-4e02-85a3-d5c890836c43 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1241 microversion: 2.1 time: 0.074077 Aug 19 15:27:28.331731 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 249/510] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:28 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:28.929028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-325d73b3-88c0-4463-b6b6-c411a9ab6851 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:28.929675 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-325d73b3-88c0-4463-b6b6-c411a9ab6851 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:28.937630 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-325d73b3-88c0-4463-b6b6-c411a9ab6851 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:28.938121 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-325d73b3-88c0-4463-b6b6-c411a9ab6851 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:28.938546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-325d73b3-88c0-4463-b6b6-c411a9ab6851 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:28.939246 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-325d73b3-88c0-4463-b6b6-c411a9ab6851 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:28.939692 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-325d73b3-88c0-4463-b6b6-c411a9ab6851 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:28.940112 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-325d73b3-88c0-4463-b6b6-c411a9ab6851 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:29.073896 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-325d73b3-88c0-4463-b6b6-c411a9ab6851 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:29.082183 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-325d73b3-88c0-4463-b6b6-c411a9ab6851 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.158072 Aug 19 15:27:29.082753 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 262/511] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:28 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:29.353483 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-48faf36f-17b6-43b8-9171-037718bd4716 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:29.355641 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-48faf36f-17b6-43b8-9171-037718bd4716 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:29.364760 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48faf36f-17b6-43b8-9171-037718bd4716 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:29.365590 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48faf36f-17b6-43b8-9171-037718bd4716 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:29.366361 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48faf36f-17b6-43b8-9171-037718bd4716 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:29.367268 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48faf36f-17b6-43b8-9171-037718bd4716 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:29.367757 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48faf36f-17b6-43b8-9171-037718bd4716 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:29.368182 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48faf36f-17b6-43b8-9171-037718bd4716 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:29.447244 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-48faf36f-17b6-43b8-9171-037718bd4716 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:29.456572 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-48faf36f-17b6-43b8-9171-037718bd4716 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1311 microversion: 2.1 time: 0.109810 Aug 19 15:27:29.457168 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 250/512] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:29 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:30.103520 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3b33823d-01c1-480e-9c5e-71948d2ead0c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:30.105738 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3b33823d-01c1-480e-9c5e-71948d2ead0c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:30.116147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b33823d-01c1-480e-9c5e-71948d2ead0c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:30.117253 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b33823d-01c1-480e-9c5e-71948d2ead0c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:30.117710 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b33823d-01c1-480e-9c5e-71948d2ead0c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:30.118619 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b33823d-01c1-480e-9c5e-71948d2ead0c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:30.119229 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b33823d-01c1-480e-9c5e-71948d2ead0c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:30.119992 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b33823d-01c1-480e-9c5e-71948d2ead0c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:30.290766 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3b33823d-01c1-480e-9c5e-71948d2ead0c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:30.301954 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3b33823d-01c1-480e-9c5e-71948d2ead0c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.202600 Aug 19 15:27:30.302853 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 263/513] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:30 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:27:30.478812 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9fb14c1e-c07f-4771-96d0-1069a23e5b2b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:30.480126 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9fb14c1e-c07f-4771-96d0-1069a23e5b2b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:30.489719 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fb14c1e-c07f-4771-96d0-1069a23e5b2b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:30.491167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fb14c1e-c07f-4771-96d0-1069a23e5b2b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:30.491798 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fb14c1e-c07f-4771-96d0-1069a23e5b2b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:30.493022 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fb14c1e-c07f-4771-96d0-1069a23e5b2b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:30.493560 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fb14c1e-c07f-4771-96d0-1069a23e5b2b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:30.494054 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fb14c1e-c07f-4771-96d0-1069a23e5b2b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:30.665545 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9fb14c1e-c07f-4771-96d0-1069a23e5b2b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:30.675727 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9fb14c1e-c07f-4771-96d0-1069a23e5b2b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1367 microversion: 2.1 time: 0.200653 Aug 19 15:27:30.680874 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 251/514] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:30 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:30.930740 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-994c96ba-1894-4922-9837-b2e6e97481a4 req-fa57cdf7-4c6f-4469-ab10-1551ac027737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99291255-ef9c-4d2a-a163-35693eb609e8", "tag": "b67e36ec-dcec-4889-867b-e63b9b85adce"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:27:30.944756 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-994c96ba-1894-4922-9837-b2e6e97481a4 req-fa57cdf7-4c6f-4469-ab10-1551ac027737 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:30.946076 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-994c96ba-1894-4922-9837-b2e6e97481a4 req-fa57cdf7-4c6f-4469-ab10-1551ac027737 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:30.946683 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-994c96ba-1894-4922-9837-b2e6e97481a4 req-fa57cdf7-4c6f-4469-ab10-1551ac027737 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:30.969903 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-994c96ba-1894-4922-9837-b2e6e97481a4 req-fa57cdf7-4c6f-4469-ab10-1551ac027737 service nova] Creating event network-changed:b67e36ec-dcec-4889-867b-e63b9b85adce for instance 99291255-ef9c-4d2a-a163-35693eb609e8 on hv-cinder-83538 Aug 19 15:27:30.975381 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-994c96ba-1894-4922-9837-b2e6e97481a4 req-fa57cdf7-4c6f-4469-ab10-1551ac027737 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049547 Aug 19 15:27:30.976572 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 264/515] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:27:31.324099 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a79d40f6-929d-4eb9-b0a2-b5d6550f046d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:31.324958 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a79d40f6-929d-4eb9-b0a2-b5d6550f046d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:31.331173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a79d40f6-929d-4eb9-b0a2-b5d6550f046d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:31.331646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a79d40f6-929d-4eb9-b0a2-b5d6550f046d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:31.332071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a79d40f6-929d-4eb9-b0a2-b5d6550f046d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:31.332780 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a79d40f6-929d-4eb9-b0a2-b5d6550f046d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:31.333223 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a79d40f6-929d-4eb9-b0a2-b5d6550f046d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:31.333704 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a79d40f6-929d-4eb9-b0a2-b5d6550f046d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:31.506218 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a79d40f6-929d-4eb9-b0a2-b5d6550f046d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:31.517249 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a79d40f6-929d-4eb9-b0a2-b5d6550f046d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.197921 Aug 19 15:27:31.530780 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 252/516] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:31 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:31.705808 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-092200ac-e1f1-4373-b9fc-d704057d4251 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:31.706513 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-092200ac-e1f1-4373-b9fc-d704057d4251 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:31.712857 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-092200ac-e1f1-4373-b9fc-d704057d4251 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:31.713470 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-092200ac-e1f1-4373-b9fc-d704057d4251 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:31.713904 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-092200ac-e1f1-4373-b9fc-d704057d4251 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:31.714856 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-092200ac-e1f1-4373-b9fc-d704057d4251 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:31.715265 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-092200ac-e1f1-4373-b9fc-d704057d4251 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:31.715675 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-092200ac-e1f1-4373-b9fc-d704057d4251 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:31.876293 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-092200ac-e1f1-4373-b9fc-d704057d4251 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:31.884255 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-092200ac-e1f1-4373-b9fc-d704057d4251 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1367 microversion: 2.1 time: 0.183293 Aug 19 15:27:31.884968 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 265/517] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:31 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:32.538177 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6eed38e8-ad50-4686-a539-d583f5ea8fdf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:32.538810 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6eed38e8-ad50-4686-a539-d583f5ea8fdf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:32.545925 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6eed38e8-ad50-4686-a539-d583f5ea8fdf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:32.546678 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6eed38e8-ad50-4686-a539-d583f5ea8fdf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:32.547111 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6eed38e8-ad50-4686-a539-d583f5ea8fdf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:32.547808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6eed38e8-ad50-4686-a539-d583f5ea8fdf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:32.548262 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6eed38e8-ad50-4686-a539-d583f5ea8fdf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:32.548708 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6eed38e8-ad50-4686-a539-d583f5ea8fdf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:32.687038 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6eed38e8-ad50-4686-a539-d583f5ea8fdf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:32.696188 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6eed38e8-ad50-4686-a539-d583f5ea8fdf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.161473 Aug 19 15:27:32.708472 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 253/518] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:32 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:32.905686 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4ef5c508-f289-40a6-8cc0-ee6db466eb70 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:32.906384 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4ef5c508-f289-40a6-8cc0-ee6db466eb70 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:32.913235 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ef5c508-f289-40a6-8cc0-ee6db466eb70 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:32.913779 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ef5c508-f289-40a6-8cc0-ee6db466eb70 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:32.914288 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ef5c508-f289-40a6-8cc0-ee6db466eb70 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:32.915046 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ef5c508-f289-40a6-8cc0-ee6db466eb70 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:32.915599 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ef5c508-f289-40a6-8cc0-ee6db466eb70 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:32.916087 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ef5c508-f289-40a6-8cc0-ee6db466eb70 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:33.055589 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4ef5c508-f289-40a6-8cc0-ee6db466eb70 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:33.063493 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4ef5c508-f289-40a6-8cc0-ee6db466eb70 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1367 microversion: 2.1 time: 0.162915 Aug 19 15:27:33.064066 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 266/519] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:32 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:33.718074 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7a2b3a52-507c-4ac8-ada8-2de0f1708c0a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:33.718685 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7a2b3a52-507c-4ac8-ada8-2de0f1708c0a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:33.725335 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a2b3a52-507c-4ac8-ada8-2de0f1708c0a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:33.725818 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a2b3a52-507c-4ac8-ada8-2de0f1708c0a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:33.726251 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a2b3a52-507c-4ac8-ada8-2de0f1708c0a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:33.726948 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a2b3a52-507c-4ac8-ada8-2de0f1708c0a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:33.727396 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a2b3a52-507c-4ac8-ada8-2de0f1708c0a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:33.727812 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a2b3a52-507c-4ac8-ada8-2de0f1708c0a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:33.875366 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7a2b3a52-507c-4ac8-ada8-2de0f1708c0a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:33.883701 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7a2b3a52-507c-4ac8-ada8-2de0f1708c0a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.169629 Aug 19 15:27:33.884267 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 254/520] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:33 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:34.084594 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d6c4d198-47cd-4d33-85dc-e239bbb0381a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:34.085216 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d6c4d198-47cd-4d33-85dc-e239bbb0381a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:34.091867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6c4d198-47cd-4d33-85dc-e239bbb0381a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:34.092347 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6c4d198-47cd-4d33-85dc-e239bbb0381a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:34.092816 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6c4d198-47cd-4d33-85dc-e239bbb0381a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:34.093516 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6c4d198-47cd-4d33-85dc-e239bbb0381a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:34.093977 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6c4d198-47cd-4d33-85dc-e239bbb0381a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:34.094403 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6c4d198-47cd-4d33-85dc-e239bbb0381a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:34.111594 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:34.236978 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d6c4d198-47cd-4d33-85dc-e239bbb0381a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:34.245598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d6c4d198-47cd-4d33-85dc-e239bbb0381a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1367 microversion: 2.1 time: 0.164809 Aug 19 15:27:34.246501 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 267/521] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:34 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:34.906505 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-936351d3-2079-4d67-8a00-f1a6bbbd19de tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:34.907118 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-936351d3-2079-4d67-8a00-f1a6bbbd19de tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:34.913530 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-936351d3-2079-4d67-8a00-f1a6bbbd19de tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:34.914003 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-936351d3-2079-4d67-8a00-f1a6bbbd19de tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:34.914427 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-936351d3-2079-4d67-8a00-f1a6bbbd19de tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:34.915110 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-936351d3-2079-4d67-8a00-f1a6bbbd19de tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:34.915551 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-936351d3-2079-4d67-8a00-f1a6bbbd19de tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:34.915967 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-936351d3-2079-4d67-8a00-f1a6bbbd19de tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:35.050808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-936351d3-2079-4d67-8a00-f1a6bbbd19de tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:35.059627 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-936351d3-2079-4d67-8a00-f1a6bbbd19de tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.157249 Aug 19 15:27:35.060232 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 255/522] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:34 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:35.267662 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3754c1c0-64c4-4da2-a6fc-ac2e8961dbd5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:35.268352 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3754c1c0-64c4-4da2-a6fc-ac2e8961dbd5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:35.275055 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3754c1c0-64c4-4da2-a6fc-ac2e8961dbd5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:35.275531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3754c1c0-64c4-4da2-a6fc-ac2e8961dbd5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:35.276033 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3754c1c0-64c4-4da2-a6fc-ac2e8961dbd5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:35.276906 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3754c1c0-64c4-4da2-a6fc-ac2e8961dbd5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:35.277360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3754c1c0-64c4-4da2-a6fc-ac2e8961dbd5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:35.277780 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3754c1c0-64c4-4da2-a6fc-ac2e8961dbd5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:35.414929 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3754c1c0-64c4-4da2-a6fc-ac2e8961dbd5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:35.423006 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3754c1c0-64c4-4da2-a6fc-ac2e8961dbd5 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1367 microversion: 2.1 time: 0.159546 Aug 19 15:27:35.423565 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 268/523] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:35 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:36.080046 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1423695a-f85e-41ba-b546-5b92e30edebf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:36.080790 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1423695a-f85e-41ba-b546-5b92e30edebf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:36.087348 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1423695a-f85e-41ba-b546-5b92e30edebf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:36.087830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1423695a-f85e-41ba-b546-5b92e30edebf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:36.088298 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1423695a-f85e-41ba-b546-5b92e30edebf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:36.089603 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1423695a-f85e-41ba-b546-5b92e30edebf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:36.090137 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1423695a-f85e-41ba-b546-5b92e30edebf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:36.090472 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1423695a-f85e-41ba-b546-5b92e30edebf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:36.227666 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1423695a-f85e-41ba-b546-5b92e30edebf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:36.236379 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1423695a-f85e-41ba-b546-5b92e30edebf tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.160185 Aug 19 15:27:36.237015 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 256/524] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:36 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:36.443132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ac66e32a-9252-47e6-880e-8f76978059e1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:36.443768 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ac66e32a-9252-47e6-880e-8f76978059e1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:36.451103 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac66e32a-9252-47e6-880e-8f76978059e1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:36.451590 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac66e32a-9252-47e6-880e-8f76978059e1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:36.452022 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac66e32a-9252-47e6-880e-8f76978059e1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:36.452738 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac66e32a-9252-47e6-880e-8f76978059e1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:36.453301 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac66e32a-9252-47e6-880e-8f76978059e1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:36.453724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac66e32a-9252-47e6-880e-8f76978059e1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:36.593218 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ac66e32a-9252-47e6-880e-8f76978059e1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:36.601039 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ac66e32a-9252-47e6-880e-8f76978059e1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1367 microversion: 2.1 time: 0.161766 Aug 19 15:27:36.601605 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 269/525] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:36 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:37.257691 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a8994a35-b86b-4d4f-8d00-49b12168c50e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:37.258297 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a8994a35-b86b-4d4f-8d00-49b12168c50e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:37.265017 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8994a35-b86b-4d4f-8d00-49b12168c50e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:37.265497 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8994a35-b86b-4d4f-8d00-49b12168c50e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:37.265928 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8994a35-b86b-4d4f-8d00-49b12168c50e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:37.266621 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8994a35-b86b-4d4f-8d00-49b12168c50e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:37.267068 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8994a35-b86b-4d4f-8d00-49b12168c50e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:37.267485 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8994a35-b86b-4d4f-8d00-49b12168c50e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:37.405290 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a8994a35-b86b-4d4f-8d00-49b12168c50e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:37.413789 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a8994a35-b86b-4d4f-8d00-49b12168c50e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.159969 Aug 19 15:27:37.414696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 257/526] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:37 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:37.622445 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2c1c4967-235d-44e1-9581-5b51554e8b8c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:37.623220 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2c1c4967-235d-44e1-9581-5b51554e8b8c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:37.629677 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c1c4967-235d-44e1-9581-5b51554e8b8c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:37.630150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c1c4967-235d-44e1-9581-5b51554e8b8c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:37.630579 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c1c4967-235d-44e1-9581-5b51554e8b8c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:37.631258 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c1c4967-235d-44e1-9581-5b51554e8b8c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:37.631701 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c1c4967-235d-44e1-9581-5b51554e8b8c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:37.632115 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c1c4967-235d-44e1-9581-5b51554e8b8c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:37.768083 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2c1c4967-235d-44e1-9581-5b51554e8b8c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:37.775753 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2c1c4967-235d-44e1-9581-5b51554e8b8c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1367 microversion: 2.1 time: 0.158055 Aug 19 15:27:37.776636 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 270/527] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:37 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:38.435893 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e223d564-fe2d-462d-a5b2-dc316391c374 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:38.436526 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e223d564-fe2d-462d-a5b2-dc316391c374 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:38.438911 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:38.444465 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e223d564-fe2d-462d-a5b2-dc316391c374 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:38.444921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e223d564-fe2d-462d-a5b2-dc316391c374 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:38.445356 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e223d564-fe2d-462d-a5b2-dc316391c374 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:38.446043 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e223d564-fe2d-462d-a5b2-dc316391c374 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:38.446494 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e223d564-fe2d-462d-a5b2-dc316391c374 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:38.446917 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e223d564-fe2d-462d-a5b2-dc316391c374 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:38.584668 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e223d564-fe2d-462d-a5b2-dc316391c374 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:38.593816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e223d564-fe2d-462d-a5b2-dc316391c374 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.162041 Aug 19 15:27:38.594396 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 258/528] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:38 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:38.797762 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8c13a917-616e-4c94-b8ec-c5f333bd13cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:38.798358 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8c13a917-616e-4c94-b8ec-c5f333bd13cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:38.800181 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:38.800858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=10 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:38.807399 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c13a917-616e-4c94-b8ec-c5f333bd13cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:38.807873 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c13a917-616e-4c94-b8ec-c5f333bd13cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:38.808301 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c13a917-616e-4c94-b8ec-c5f333bd13cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:38.809014 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c13a917-616e-4c94-b8ec-c5f333bd13cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:38.809462 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c13a917-616e-4c94-b8ec-c5f333bd13cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:38.809884 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c13a917-616e-4c94-b8ec-c5f333bd13cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:38.943352 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8c13a917-616e-4c94-b8ec-c5f333bd13cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:38.951453 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8c13a917-616e-4c94-b8ec-c5f333bd13cc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1367 microversion: 2.1 time: 0.157781 Aug 19 15:27:38.952018 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 271/529] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:38 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:27:39.614986 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3dca5156-8c67-4419-a5cb-1de68a893c48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:39.615578 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3dca5156-8c67-4419-a5cb-1de68a893c48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:39.622583 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3dca5156-8c67-4419-a5cb-1de68a893c48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:39.623072 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3dca5156-8c67-4419-a5cb-1de68a893c48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:39.623509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3dca5156-8c67-4419-a5cb-1de68a893c48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:39.624212 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3dca5156-8c67-4419-a5cb-1de68a893c48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:39.624703 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3dca5156-8c67-4419-a5cb-1de68a893c48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:39.625122 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3dca5156-8c67-4419-a5cb-1de68a893c48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:39.763290 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3dca5156-8c67-4419-a5cb-1de68a893c48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:39.771832 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3dca5156-8c67-4419-a5cb-1de68a893c48 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.160630 Aug 19 15:27:39.772449 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 259/530] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:39 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:27:39.974854 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3bcbab1f-b61e-431d-a195-f188d195b96a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:39.975404 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3bcbab1f-b61e-431d-a195-f188d195b96a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:39.978106 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:39.985081 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3bcbab1f-b61e-431d-a195-f188d195b96a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:39.985570 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3bcbab1f-b61e-431d-a195-f188d195b96a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:39.985989 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3bcbab1f-b61e-431d-a195-f188d195b96a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:39.986707 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3bcbab1f-b61e-431d-a195-f188d195b96a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:39.987153 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3bcbab1f-b61e-431d-a195-f188d195b96a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:39.987567 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3bcbab1f-b61e-431d-a195-f188d195b96a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:40.059464 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-68218a83-e986-414f-bafa-cb98fb739000 req-db740372-57aa-4fd3-a136-87a314c4645d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99291255-ef9c-4d2a-a163-35693eb609e8", "name": "network-vif-plugged", "status": "completed", "tag": "b67e36ec-dcec-4889-867b-e63b9b85adce"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:27:40.073322 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-68218a83-e986-414f-bafa-cb98fb739000 req-db740372-57aa-4fd3-a136-87a314c4645d service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:40.074031 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-68218a83-e986-414f-bafa-cb98fb739000 req-db740372-57aa-4fd3-a136-87a314c4645d service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:40.074654 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-68218a83-e986-414f-bafa-cb98fb739000 req-db740372-57aa-4fd3-a136-87a314c4645d service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:40.089117 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-68218a83-e986-414f-bafa-cb98fb739000 req-db740372-57aa-4fd3-a136-87a314c4645d service nova] Creating event network-vif-plugged:b67e36ec-dcec-4889-867b-e63b9b85adce for instance 99291255-ef9c-4d2a-a163-35693eb609e8 on hv-cinder-83538 Aug 19 15:27:40.095052 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-68218a83-e986-414f-bafa-cb98fb739000 req-db740372-57aa-4fd3-a136-87a314c4645d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040102 Aug 19 15:27:40.095652 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 260/531] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:27:40.132013 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3bcbab1f-b61e-431d-a195-f188d195b96a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:40.141058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3bcbab1f-b61e-431d-a195-f188d195b96a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1367 microversion: 2.1 time: 0.171800 Aug 19 15:27:40.141641 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 272/532] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:39 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:40.793531 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-824a493c-2dc3-4936-82da-6f02ad597f2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:40.794229 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-824a493c-2dc3-4936-82da-6f02ad597f2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:40.800641 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-824a493c-2dc3-4936-82da-6f02ad597f2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:40.801125 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-824a493c-2dc3-4936-82da-6f02ad597f2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:40.801552 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-824a493c-2dc3-4936-82da-6f02ad597f2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:40.802247 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-824a493c-2dc3-4936-82da-6f02ad597f2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:40.802697 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-824a493c-2dc3-4936-82da-6f02ad597f2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:40.803210 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-824a493c-2dc3-4936-82da-6f02ad597f2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:40.935869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-824a493c-2dc3-4936-82da-6f02ad597f2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:40.944236 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-824a493c-2dc3-4936-82da-6f02ad597f2a tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.155463 Aug 19 15:27:40.944839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 261/533] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:40 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:41.162137 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-23e7e84b-dede-40e4-a2fa-fd55f454f79f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:41.162718 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-23e7e84b-dede-40e4-a2fa-fd55f454f79f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:41.171011 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23e7e84b-dede-40e4-a2fa-fd55f454f79f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:41.171740 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23e7e84b-dede-40e4-a2fa-fd55f454f79f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:41.173996 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23e7e84b-dede-40e4-a2fa-fd55f454f79f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:41.173996 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23e7e84b-dede-40e4-a2fa-fd55f454f79f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:41.173996 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23e7e84b-dede-40e4-a2fa-fd55f454f79f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:41.173996 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23e7e84b-dede-40e4-a2fa-fd55f454f79f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:41.321408 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-23e7e84b-dede-40e4-a2fa-fd55f454f79f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:41.329826 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-23e7e84b-dede-40e4-a2fa-fd55f454f79f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1367 microversion: 2.1 time: 0.171569 Aug 19 15:27:41.330392 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 273/534] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:41 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:41.966086 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-51c878ad-5478-4afc-a41f-f79263dc61e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:41.966616 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-51c878ad-5478-4afc-a41f-f79263dc61e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:41.973247 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51c878ad-5478-4afc-a41f-f79263dc61e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:41.973737 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51c878ad-5478-4afc-a41f-f79263dc61e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:41.974165 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51c878ad-5478-4afc-a41f-f79263dc61e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:41.974855 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51c878ad-5478-4afc-a41f-f79263dc61e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:41.975299 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51c878ad-5478-4afc-a41f-f79263dc61e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:41.975715 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51c878ad-5478-4afc-a41f-f79263dc61e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:41.994192 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:42.115328 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-51c878ad-5478-4afc-a41f-f79263dc61e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:42.124435 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-51c878ad-5478-4afc-a41f-f79263dc61e2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.162218 Aug 19 15:27:42.125014 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 262/535] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:41 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:42.351208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-53c97ad8-b4ef-4a4c-a325-dfc593b63b5e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:42.351878 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-53c97ad8-b4ef-4a4c-a325-dfc593b63b5e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:42.359092 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53c97ad8-b4ef-4a4c-a325-dfc593b63b5e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:42.359568 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53c97ad8-b4ef-4a4c-a325-dfc593b63b5e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:42.359996 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53c97ad8-b4ef-4a4c-a325-dfc593b63b5e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:42.360848 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53c97ad8-b4ef-4a4c-a325-dfc593b63b5e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:42.361299 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53c97ad8-b4ef-4a4c-a325-dfc593b63b5e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:42.361714 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53c97ad8-b4ef-4a4c-a325-dfc593b63b5e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:42.497132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-53c97ad8-b4ef-4a4c-a325-dfc593b63b5e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:42.504798 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-53c97ad8-b4ef-4a4c-a325-dfc593b63b5e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1367 microversion: 2.1 time: 0.157433 Aug 19 15:27:42.505360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 274/536] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:42 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:43.145264 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-64e5ea32-c92d-4247-bd88-c2076ed69524 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:43.145866 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-64e5ea32-c92d-4247-bd88-c2076ed69524 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:43.153070 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64e5ea32-c92d-4247-bd88-c2076ed69524 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:43.153548 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64e5ea32-c92d-4247-bd88-c2076ed69524 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:43.153978 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64e5ea32-c92d-4247-bd88-c2076ed69524 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:43.154654 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64e5ea32-c92d-4247-bd88-c2076ed69524 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:43.155099 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64e5ea32-c92d-4247-bd88-c2076ed69524 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:43.155515 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64e5ea32-c92d-4247-bd88-c2076ed69524 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:43.296064 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-64e5ea32-c92d-4247-bd88-c2076ed69524 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:43.304521 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-64e5ea32-c92d-4247-bd88-c2076ed69524 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.163114 Aug 19 15:27:43.305092 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 263/537] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:43 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:43.526977 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-49d7dcbc-8f7f-4ba2-891c-e45162325511 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:43.527607 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-49d7dcbc-8f7f-4ba2-891c-e45162325511 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:43.534171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49d7dcbc-8f7f-4ba2-891c-e45162325511 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:43.534639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49d7dcbc-8f7f-4ba2-891c-e45162325511 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:43.535061 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49d7dcbc-8f7f-4ba2-891c-e45162325511 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:43.535740 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49d7dcbc-8f7f-4ba2-891c-e45162325511 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:43.536181 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49d7dcbc-8f7f-4ba2-891c-e45162325511 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:43.536630 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49d7dcbc-8f7f-4ba2-891c-e45162325511 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:43.672168 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-49d7dcbc-8f7f-4ba2-891c-e45162325511 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:43.680532 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-49d7dcbc-8f7f-4ba2-891c-e45162325511 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1367 microversion: 2.1 time: 0.157878 Aug 19 15:27:43.681105 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 275/538] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:43 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:44.325990 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-00f44893-2e75-4590-a91c-9ca6dc47c1f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:44.326579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-00f44893-2e75-4590-a91c-9ca6dc47c1f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:44.333049 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00f44893-2e75-4590-a91c-9ca6dc47c1f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:44.333530 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00f44893-2e75-4590-a91c-9ca6dc47c1f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:44.333968 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00f44893-2e75-4590-a91c-9ca6dc47c1f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:44.334647 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00f44893-2e75-4590-a91c-9ca6dc47c1f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:44.335097 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00f44893-2e75-4590-a91c-9ca6dc47c1f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:44.335511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00f44893-2e75-4590-a91c-9ca6dc47c1f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:44.467530 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-00f44893-2e75-4590-a91c-9ca6dc47c1f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:44.475758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-00f44893-2e75-4590-a91c-9ca6dc47c1f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1735 microversion: 2.1 time: 0.153703 Aug 19 15:27:44.476318 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 264/539] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:44 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:44.702597 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-78f591dd-0c43-4b91-97de-2536db7cf3f9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:44.703198 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-78f591dd-0c43-4b91-97de-2536db7cf3f9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:44.709682 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78f591dd-0c43-4b91-97de-2536db7cf3f9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:44.710150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78f591dd-0c43-4b91-97de-2536db7cf3f9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:44.710572 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78f591dd-0c43-4b91-97de-2536db7cf3f9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:44.711284 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78f591dd-0c43-4b91-97de-2536db7cf3f9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:44.711723 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78f591dd-0c43-4b91-97de-2536db7cf3f9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:44.712137 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78f591dd-0c43-4b91-97de-2536db7cf3f9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:44.846547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-78f591dd-0c43-4b91-97de-2536db7cf3f9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:44.855472 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-78f591dd-0c43-4b91-97de-2536db7cf3f9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1557 microversion: 2.1 time: 0.157353 Aug 19 15:27:44.856049 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 276/540] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:44 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:44.875127 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6765faf8-da96-4784-a888-ed9d829c13ad tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:44.875617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6765faf8-da96-4784-a888-ed9d829c13ad tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:44.881729 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6765faf8-da96-4784-a888-ed9d829c13ad tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:44.882220 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6765faf8-da96-4784-a888-ed9d829c13ad tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:44.882683 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6765faf8-da96-4784-a888-ed9d829c13ad tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:44.883376 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6765faf8-da96-4784-a888-ed9d829c13ad tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:44.883826 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6765faf8-da96-4784-a888-ed9d829c13ad tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:44.884255 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6765faf8-da96-4784-a888-ed9d829c13ad tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:44.970553 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6765faf8-da96-4784-a888-ed9d829c13ad tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099200 Aug 19 15:27:44.971436 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 265/541] 10.222.0.75 () {58 vars in 1275 bytes} [Fri Aug 19 15:27:44 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:27:45.501360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9186a4bd-956a-49a3-a09c-deb05717a78e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:45.501360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9186a4bd-956a-49a3-a09c-deb05717a78e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:45.505758 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9186a4bd-956a-49a3-a09c-deb05717a78e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:45.506254 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9186a4bd-956a-49a3-a09c-deb05717a78e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:45.506774 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9186a4bd-956a-49a3-a09c-deb05717a78e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:45.508328 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9186a4bd-956a-49a3-a09c-deb05717a78e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:45.508862 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9186a4bd-956a-49a3-a09c-deb05717a78e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:45.509290 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9186a4bd-956a-49a3-a09c-deb05717a78e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:45.699915 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9186a4bd-956a-49a3-a09c-deb05717a78e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:45.714991 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9186a4bd-956a-49a3-a09c-deb05717a78e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1715 microversion: 2.1 time: 0.221542 Aug 19 15:27:45.729911 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 277/542] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:45 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1715 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:45.858231 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eb6c30f8-e8f9-4846-b66c-f57ff77fddb6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:45.858792 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eb6c30f8-e8f9-4846-b66c-f57ff77fddb6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:45.866152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb6c30f8-e8f9-4846-b66c-f57ff77fddb6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:45.866760 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb6c30f8-e8f9-4846-b66c-f57ff77fddb6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:45.867202 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb6c30f8-e8f9-4846-b66c-f57ff77fddb6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:45.868014 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb6c30f8-e8f9-4846-b66c-f57ff77fddb6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:45.868511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb6c30f8-e8f9-4846-b66c-f57ff77fddb6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:45.868936 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb6c30f8-e8f9-4846-b66c-f57ff77fddb6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:45.977472 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-eb6c30f8-e8f9-4846-b66c-f57ff77fddb6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] HTTP exception thrown: Cannot 'detach_volume' instance c73df7a2-f347-4f80-8853-f5ea25b0cbc7 while it is in vm_state rescued Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eb6c30f8-e8f9-4846-b66c-f57ff77fddb6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Request method failure captured: Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-volume_attachments/aa5eefef-e385-41d6-a000-84c88e4aa67c HTTP/1.1 Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6rldajWYu2a-wna4OYo7oT4PcVjfwOm5e53qr2wAzq1ke5P0YP7OvzwS0BQ7ZlWVHc9-8RfuQH42A1aK3RMPmXHvxct5oXkEXNEyZU87L546gCy6y0evh0UzcyVgOF-eIz1PDrc-6_6aRbz90Zhzpipvod_2wqGIrmzTxACvIsXGwY Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: dcca6c7d30114cd0936eb30381efad7d Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-592584515 Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:27:45.979200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:27:45.980800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_dcca6c7d30114cd0936eb30381efad7d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcca6c7d30114cd0936eb30381efad7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcca6c7d30114cd0936eb30381efad7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/dcca6c7d30114cd0936eb30381efad7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:27:45.980800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-ServerRescueNegativeTestJSON-592584515 Aug 19 15:27:45.980800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: dcca6c7d30114cd0936eb30381efad7d Aug 19 15:27:45.980800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-592584515 Aug 19 15:27:45.980800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-ServerRescueNegativeTestJSON-592584515-project Aug 19 15:27:45.980800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:27:45.980800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:27:45.980800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: 218f3dd17e6549fc8796eb30e4b48e24 Aug 19 15:27:45.980800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-ServerRescueNegativeTestJSON-592584515-project Aug 19 15:27:45.980800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:27:45.980800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Cannot 'detach_volume' instance c73df7a2-f347-4f80-8853-f5ea25b0cbc7 while it is in vm_state rescued Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'server_id': 'c73df7a2-f347-4f80-8853-f5ea25b0cbc7', 'id': 'aa5eefef-e385-41d6-a000-84c88e4aa67c'} Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c73df7a2-f347-4f80-8853-f5ea25b0cbc7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:27:45.981525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:27:45.982960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 19 15:27:45.982960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 19 15:27:45.982960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 19 15:27:45.982960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 19 15:27:45.982960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c73df7a2-f347-4f80-8853-f5ea25b0cbc7 while it is in vm_state rescued Aug 19 15:27:45.982960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:45.982960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:27:45.982960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:45.982960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:27:45.982960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:27:45.982960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:27:45.982960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:27:45.982960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:27:45.982960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c73df7a2-f347-4f80-8853-f5ea25b0cbc7 while it is in vm_state rescued Aug 19 15:27:45.982960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:27:45.982960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eb6c30f8-e8f9-4846-b66c-f57ff77fddb6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Returning 409 to user: Cannot 'detach_volume' instance c73df7a2-f347-4f80-8853-f5ea25b0cbc7 while it is in vm_state rescued {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:27:45.983921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eb6c30f8-e8f9-4846-b66c-f57ff77fddb6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-volume_attachments/aa5eefef-e385-41d6-a000-84c88e4aa67c" status: 409 len: 152 microversion: 2.1 time: 0.128404 Aug 19 15:27:45.983921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 266/543] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Aug 19 15:27:45 2022] DELETE /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-volume_attachments/aa5eefef-e385-41d6-a000-84c88e4aa67c => generated 152 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 19 15:27:45.996302 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7b77898d-16f0-4bbb-8870-69a3fae362b9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:27:45.997112 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7b77898d-16f0-4bbb-8870-69a3fae362b9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:46.004199 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b77898d-16f0-4bbb-8870-69a3fae362b9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:46.004721 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b77898d-16f0-4bbb-8870-69a3fae362b9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:46.005233 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b77898d-16f0-4bbb-8870-69a3fae362b9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:46.006490 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b77898d-16f0-4bbb-8870-69a3fae362b9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:46.007308 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b77898d-16f0-4bbb-8870-69a3fae362b9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:46.008055 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b77898d-16f0-4bbb-8870-69a3fae362b9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:46.092200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7b77898d-16f0-4bbb-8870-69a3fae362b9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "POST /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/action" status: 202 len: 0 microversion: 2.1 time: 0.101608 Aug 19 15:27:46.093029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 278/544] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Aug 19 15:27:45 2022] POST /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:27:46.101557 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-21c5cc4e-a9e1-4014-b52b-d672349830a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:46.102506 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-21c5cc4e-a9e1-4014-b52b-d672349830a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:46.110192 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21c5cc4e-a9e1-4014-b52b-d672349830a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:46.110784 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21c5cc4e-a9e1-4014-b52b-d672349830a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:46.111194 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21c5cc4e-a9e1-4014-b52b-d672349830a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:46.112003 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21c5cc4e-a9e1-4014-b52b-d672349830a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:46.112516 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21c5cc4e-a9e1-4014-b52b-d672349830a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:46.112943 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21c5cc4e-a9e1-4014-b52b-d672349830a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:46.248695 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-21c5cc4e-a9e1-4014-b52b-d672349830a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:46.257992 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-21c5cc4e-a9e1-4014-b52b-d672349830a6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1723 microversion: 2.1 time: 0.160360 Aug 19 15:27:46.258565 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 267/545] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:46 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:46.722242 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-89019e63-8bac-4d8f-8b65-30530faff33a req-084b8c3a-3a6b-4dd6-9af2-e6d5f56c1588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99291255-ef9c-4d2a-a163-35693eb609e8", "tag": "b67e36ec-dcec-4889-867b-e63b9b85adce"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:27:46.733799 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-89019e63-8bac-4d8f-8b65-30530faff33a req-084b8c3a-3a6b-4dd6-9af2-e6d5f56c1588 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:46.734569 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-89019e63-8bac-4d8f-8b65-30530faff33a req-084b8c3a-3a6b-4dd6-9af2-e6d5f56c1588 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:46.734995 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-89019e63-8bac-4d8f-8b65-30530faff33a req-084b8c3a-3a6b-4dd6-9af2-e6d5f56c1588 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:46.750799 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-89019e63-8bac-4d8f-8b65-30530faff33a req-084b8c3a-3a6b-4dd6-9af2-e6d5f56c1588 service nova] Creating event network-changed:b67e36ec-dcec-4889-867b-e63b9b85adce for instance 99291255-ef9c-4d2a-a163-35693eb609e8 on hv-cinder-83538 Aug 19 15:27:46.757624 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-89019e63-8bac-4d8f-8b65-30530faff33a req-084b8c3a-3a6b-4dd6-9af2-e6d5f56c1588 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039728 Aug 19 15:27:46.759044 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 279/546] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:27:47.279977 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b275dcdf-8661-48c6-8250-719d875d6b01 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:47.280681 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b275dcdf-8661-48c6-8250-719d875d6b01 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:47.283093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:47.288684 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b275dcdf-8661-48c6-8250-719d875d6b01 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:47.289177 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b275dcdf-8661-48c6-8250-719d875d6b01 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:47.289608 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b275dcdf-8661-48c6-8250-719d875d6b01 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:47.290319 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b275dcdf-8661-48c6-8250-719d875d6b01 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:47.290763 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b275dcdf-8661-48c6-8250-719d875d6b01 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:47.291179 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b275dcdf-8661-48c6-8250-719d875d6b01 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:47.440667 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b275dcdf-8661-48c6-8250-719d875d6b01 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:47.450696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b275dcdf-8661-48c6-8250-719d875d6b01 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1723 microversion: 2.1 time: 0.175035 Aug 19 15:27:47.451274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 268/547] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:47 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:48.473444 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f2aefde5-c9b0-4447-8b96-730741c654e7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:48.474132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f2aefde5-c9b0-4447-8b96-730741c654e7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:48.480468 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2aefde5-c9b0-4447-8b96-730741c654e7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:48.481505 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2aefde5-c9b0-4447-8b96-730741c654e7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:48.481940 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2aefde5-c9b0-4447-8b96-730741c654e7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:48.482762 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2aefde5-c9b0-4447-8b96-730741c654e7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:48.483104 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2aefde5-c9b0-4447-8b96-730741c654e7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:48.483518 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2aefde5-c9b0-4447-8b96-730741c654e7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:48.625674 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f2aefde5-c9b0-4447-8b96-730741c654e7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:48.633901 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f2aefde5-c9b0-4447-8b96-730741c654e7 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1723 microversion: 2.1 time: 0.165231 Aug 19 15:27:48.634834 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 280/548] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:48 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:49.656946 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9f338d6d-097e-4494-92d5-d4874a3f2676 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:49.657619 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9f338d6d-097e-4494-92d5-d4874a3f2676 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:49.664312 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f338d6d-097e-4494-92d5-d4874a3f2676 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:49.664820 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f338d6d-097e-4494-92d5-d4874a3f2676 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:49.665253 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f338d6d-097e-4494-92d5-d4874a3f2676 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:49.665933 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f338d6d-097e-4494-92d5-d4874a3f2676 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:49.666377 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f338d6d-097e-4494-92d5-d4874a3f2676 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:49.666791 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f338d6d-097e-4494-92d5-d4874a3f2676 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:49.798553 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f338d6d-097e-4494-92d5-d4874a3f2676 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:49.806846 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9f338d6d-097e-4494-92d5-d4874a3f2676 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1729 microversion: 2.1 time: 0.155462 Aug 19 15:27:49.807413 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 269/549] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:49 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:49.828205 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3a1eea30-71c8-4798-bac0-be43af0e5ca5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:49.828867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3a1eea30-71c8-4798-bac0-be43af0e5ca5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:49.836022 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a1eea30-71c8-4798-bac0-be43af0e5ca5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:49.836887 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a1eea30-71c8-4798-bac0-be43af0e5ca5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:49.837699 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a1eea30-71c8-4798-bac0-be43af0e5ca5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:49.838983 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a1eea30-71c8-4798-bac0-be43af0e5ca5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:49.839769 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a1eea30-71c8-4798-bac0-be43af0e5ca5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:49.841180 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a1eea30-71c8-4798-bac0-be43af0e5ca5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:49.934607 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3a1eea30-71c8-4798-bac0-be43af0e5ca5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110582 Aug 19 15:27:49.935199 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 281/550] 10.222.0.75 () {58 vars in 1275 bytes} [Fri Aug 19 15:27:49 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:27:50.900514 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-28a783c3-5a99-467f-8514-ae4ebd8b8543 req-6eb6354d-dca0-4dd0-bd45-17884c7956ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73df7a2-f347-4f80-8853-f5ea25b0cbc7", "tag": "ca54f86e-c00b-4076-ac42-4e78405cb1a7"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:27:50.914065 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-28a783c3-5a99-467f-8514-ae4ebd8b8543 req-6eb6354d-dca0-4dd0-bd45-17884c7956ae service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:50.915127 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-28a783c3-5a99-467f-8514-ae4ebd8b8543 req-6eb6354d-dca0-4dd0-bd45-17884c7956ae service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:50.915771 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-28a783c3-5a99-467f-8514-ae4ebd8b8543 req-6eb6354d-dca0-4dd0-bd45-17884c7956ae service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:50.936295 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-28a783c3-5a99-467f-8514-ae4ebd8b8543 req-6eb6354d-dca0-4dd0-bd45-17884c7956ae service nova] Creating event network-changed:ca54f86e-c00b-4076-ac42-4e78405cb1a7 for instance c73df7a2-f347-4f80-8853-f5ea25b0cbc7 on hv-cinder-83538 Aug 19 15:27:50.946605 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-28a783c3-5a99-467f-8514-ae4ebd8b8543 req-6eb6354d-dca0-4dd0-bd45-17884c7956ae service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047276 Aug 19 15:27:50.947959 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 270/551] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:27:53.192582 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-f3501343-e1da-4a21-95bd-6753be1c0002 req-559b2202-c33b-4e5d-aea2-f9b5464aee97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73df7a2-f347-4f80-8853-f5ea25b0cbc7", "tag": "ca54f86e-c00b-4076-ac42-4e78405cb1a7"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:27:53.202561 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f3501343-e1da-4a21-95bd-6753be1c0002 req-559b2202-c33b-4e5d-aea2-f9b5464aee97 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:53.203329 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f3501343-e1da-4a21-95bd-6753be1c0002 req-559b2202-c33b-4e5d-aea2-f9b5464aee97 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:53.211082 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f3501343-e1da-4a21-95bd-6753be1c0002 req-559b2202-c33b-4e5d-aea2-f9b5464aee97 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:53.220456 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-f3501343-e1da-4a21-95bd-6753be1c0002 req-559b2202-c33b-4e5d-aea2-f9b5464aee97 service nova] Creating event network-changed:ca54f86e-c00b-4076-ac42-4e78405cb1a7 for instance c73df7a2-f347-4f80-8853-f5ea25b0cbc7 on hv-cinder-83538 Aug 19 15:27:53.226275 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-f3501343-e1da-4a21-95bd-6753be1c0002 req-559b2202-c33b-4e5d-aea2-f9b5464aee97 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039122 Aug 19 15:27:53.227008 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 282/552] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:27:57.361458 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-381572bc-e912-455f-b6d1-41a6ff5dfb56 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:57.364460 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-381572bc-e912-455f-b6d1-41a6ff5dfb56 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:57.372215 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-381572bc-e912-455f-b6d1-41a6ff5dfb56 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:57.373188 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-381572bc-e912-455f-b6d1-41a6ff5dfb56 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:57.373871 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-381572bc-e912-455f-b6d1-41a6ff5dfb56 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:57.374807 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-381572bc-e912-455f-b6d1-41a6ff5dfb56 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:57.375474 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-381572bc-e912-455f-b6d1-41a6ff5dfb56 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:57.376111 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-381572bc-e912-455f-b6d1-41a6ff5dfb56 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:57.408420 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-381572bc-e912-455f-b6d1-41a6ff5dfb56 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051123 Aug 19 15:27:57.409104 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 271/553] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:27:57 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 15:27:57.480483 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-16302299-0049-4319-94c1-fd8dd3034239 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:57.481806 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-16302299-0049-4319-94c1-fd8dd3034239 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:57.492519 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16302299-0049-4319-94c1-fd8dd3034239 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:57.493286 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16302299-0049-4319-94c1-fd8dd3034239 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:57.493878 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16302299-0049-4319-94c1-fd8dd3034239 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:57.494742 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16302299-0049-4319-94c1-fd8dd3034239 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:57.495887 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16302299-0049-4319-94c1-fd8dd3034239 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:57.496749 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16302299-0049-4319-94c1-fd8dd3034239 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:57.534630 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-16302299-0049-4319-94c1-fd8dd3034239 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:27:57.572202 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:57.639148 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-16302299-0049-4319-94c1-fd8dd3034239 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 204 len: 0 microversion: 2.1 time: 0.164092 Aug 19 15:27:57.640799 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 283/554] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:27:57 2022] DELETE /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:27:57.649500 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-85369d3d-3e58-4d9f-8f03-b3c51c970b6c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:57.650150 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-85369d3d-3e58-4d9f-8f03-b3c51c970b6c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:57.660209 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85369d3d-3e58-4d9f-8f03-b3c51c970b6c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:57.661346 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85369d3d-3e58-4d9f-8f03-b3c51c970b6c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:57.662066 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85369d3d-3e58-4d9f-8f03-b3c51c970b6c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:57.663024 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85369d3d-3e58-4d9f-8f03-b3c51c970b6c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:57.663564 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85369d3d-3e58-4d9f-8f03-b3c51c970b6c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:57.664066 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85369d3d-3e58-4d9f-8f03-b3c51c970b6c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:57.933669 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-85369d3d-3e58-4d9f-8f03-b3c51c970b6c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:57.943650 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-85369d3d-3e58-4d9f-8f03-b3c51c970b6c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1674 microversion: 2.1 time: 0.297957 Aug 19 15:27:57.945136 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 272/555] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:57 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1674 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:27:58.968435 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a6e90f51-cae9-4704-8c46-c162e9650af0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:27:58.969621 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a6e90f51-cae9-4704-8c46-c162e9650af0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:27:58.976618 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6e90f51-cae9-4704-8c46-c162e9650af0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:58.977429 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6e90f51-cae9-4704-8c46-c162e9650af0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:58.978113 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6e90f51-cae9-4704-8c46-c162e9650af0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:58.979073 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6e90f51-cae9-4704-8c46-c162e9650af0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:27:58.979742 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6e90f51-cae9-4704-8c46-c162e9650af0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:27:58.980372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6e90f51-cae9-4704-8c46-c162e9650af0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:27:59.154211 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a6e90f51-cae9-4704-8c46-c162e9650af0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:27:59.163376 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a6e90f51-cae9-4704-8c46-c162e9650af0 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1674 microversion: 2.1 time: 0.200770 Aug 19 15:27:59.164469 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 284/556] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:27:58 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1674 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:00.190777 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4e00c5db-ab30-4b3d-83d2-800062b98cab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:00.192089 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4e00c5db-ab30-4b3d-83d2-800062b98cab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:00.205868 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e00c5db-ab30-4b3d-83d2-800062b98cab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:00.206623 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e00c5db-ab30-4b3d-83d2-800062b98cab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:00.207338 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e00c5db-ab30-4b3d-83d2-800062b98cab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:00.208263 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e00c5db-ab30-4b3d-83d2-800062b98cab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:00.209286 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e00c5db-ab30-4b3d-83d2-800062b98cab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:00.213191 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e00c5db-ab30-4b3d-83d2-800062b98cab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:00.452202 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4e00c5db-ab30-4b3d-83d2-800062b98cab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:00.470422 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4e00c5db-ab30-4b3d-83d2-800062b98cab tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1674 microversion: 2.1 time: 0.283091 Aug 19 15:28:00.472625 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 273/557] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:00 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1674 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:28:01.496931 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-12c025bd-cbea-47ad-abf4-82e786dcbdc8 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:01.497616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-12c025bd-cbea-47ad-abf4-82e786dcbdc8 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:01.508344 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12c025bd-cbea-47ad-abf4-82e786dcbdc8 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:01.509573 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12c025bd-cbea-47ad-abf4-82e786dcbdc8 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:01.510242 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12c025bd-cbea-47ad-abf4-82e786dcbdc8 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:01.511218 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12c025bd-cbea-47ad-abf4-82e786dcbdc8 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:01.512490 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12c025bd-cbea-47ad-abf4-82e786dcbdc8 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:01.513276 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12c025bd-cbea-47ad-abf4-82e786dcbdc8 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:01.910857 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-12c025bd-cbea-47ad-abf4-82e786dcbdc8 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:01.920021 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-12c025bd-cbea-47ad-abf4-82e786dcbdc8 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 200 len: 1606 microversion: 2.1 time: 0.429444 Aug 19 15:28:01.920656 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 285/558] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:01 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 1606 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:02.288602 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-33a388dd-9511-4c35-b05c-d2bd04088fc1 req-d820e3c4-bbc4-428e-af12-ef0b9ba39778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d", "name": "network-vif-deleted", "tag": "489cb252-e00c-4932-b659-de93c87cfb6a"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:02.304472 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-33a388dd-9511-4c35-b05c-d2bd04088fc1 req-d820e3c4-bbc4-428e-af12-ef0b9ba39778 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:02.305678 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-33a388dd-9511-4c35-b05c-d2bd04088fc1 req-d820e3c4-bbc4-428e-af12-ef0b9ba39778 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:02.305908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-33a388dd-9511-4c35-b05c-d2bd04088fc1 req-d820e3c4-bbc4-428e-af12-ef0b9ba39778 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:02.325183 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-33a388dd-9511-4c35-b05c-d2bd04088fc1 req-d820e3c4-bbc4-428e-af12-ef0b9ba39778 service nova] Creating event network-vif-deleted:489cb252-e00c-4932-b659-de93c87cfb6a for instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d on hv-cinder-83538 Aug 19 15:28:02.334033 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-33a388dd-9511-4c35-b05c-d2bd04088fc1 req-d820e3c4-bbc4-428e-af12-ef0b9ba39778 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050177 Aug 19 15:28:02.336091 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 274/559] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:02.942367 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a3453956-83db-495a-a6ba-748f52ed08c9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:02.943064 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a3453956-83db-495a-a6ba-748f52ed08c9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:02.951236 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3453956-83db-495a-a6ba-748f52ed08c9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:02.952023 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3453956-83db-495a-a6ba-748f52ed08c9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:02.952722 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3453956-83db-495a-a6ba-748f52ed08c9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:02.953501 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3453956-83db-495a-a6ba-748f52ed08c9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:02.954016 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3453956-83db-495a-a6ba-748f52ed08c9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:02.954506 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3453956-83db-495a-a6ba-748f52ed08c9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:02.970028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-a3453956-83db-495a-a6ba-748f52ed08c9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] HTTP exception thrown: Instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d could not be found. Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a3453956-83db-495a-a6ba-748f52ed08c9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Request method failure captured: Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d HTTP/1.1 Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6rgteu55BhEMXr07OZCBOE44QcyuSzZTeJBt8qZaIsufjVVkhXgCgF6ZnBN0ca8ot6FhrE0fpF7ptahmZHtMWFSXJfCnb4K9DP9dKGaDlDrh1wv5jXTRWoVRkxkPuOSqnHFbuwHUJwXkgd8-gt6_KNOgegj75abwvvr95XCIigXC-c Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: 8ede055158e24b7c9a935b833e33b89a Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeTestJSON-361413854 Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:28:02.972926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:28:02.974447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8ede055158e24b7c9a935b833e33b89a", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8ede055158e24b7c9a935b833e33b89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8ede055158e24b7c9a935b833e33b89a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8ede055158e24b7c9a935b833e33b89a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:28:02.974447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeTestJSON-361413854 Aug 19 15:28:02.974447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 8ede055158e24b7c9a935b833e33b89a Aug 19 15:28:02.974447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361413854 Aug 19 15:28:02.974447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeTestJSON-361413854-project Aug 19 15:28:02.974447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:28:02.974447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:28:02.974447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: dc2bbdceb12641e6a0595e68f7cefd63 Aug 19 15:28:02.974447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeTestJSON-361413854-project Aug 19 15:28:02.974447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:28:02.974447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d could not be found. Aug 19 15:28:02.974447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': 'f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d'} Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d could not be found. Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:28:02.975592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:28:02.977178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:28:02.977178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:28:02.977178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:28:02.977178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:28:02.977178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:28:02.977178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:28:02.977178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:28:02.977178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d could not be found. Aug 19 15:28:02.977178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:02.977178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:28:02.977178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:02.977178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:28:02.977178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:28:02.977178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:28:02.977178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:28:02.977178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:28:02.977178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d could not be found. Aug 19 15:28:02.977178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:02.984233 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a3453956-83db-495a-a6ba-748f52ed08c9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Returning 404 to user: Instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:28:02.985356 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a3453956-83db-495a-a6ba-748f52ed08c9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 404 len: 111 microversion: 2.1 time: 0.046860 Aug 19 15:28:02.989546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 286/560] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:02 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:28:03.006096 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-56fc514f-fd7b-40af-9b5b-86a50bb1ca70 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '.version_select at 0x7fb5336363a0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:03.033617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-56fc514f-fd7b-40af-9b5b-86a50bb1ca70 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-832006233" status: 202 len: 0 microversion: 2.1 time: 0.036350 Aug 19 15:28:03.043374 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 275/561] 10.222.0.75 () {58 vars in 1218 bytes} [Fri Aug 19 15:28:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-832006233 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:28:04.131849 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9c5e73f3-4da1-4281-bf85-a515116de0c2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Action: 'create', calling method: .version_select at 0x7fb5332ea9d0>, body: {"keypair": {"name": "tempest-keypair-1419104470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAThnTYZ10lRjysuwe5WJiCEiEzS2tWv61c/P2uJIY3bKyK1C4G8b2+/ZDcmjGwn3Jrg24dsh0VtkQg8zP4WPYamudE5GBu9wVQqCGk/1yssav7ggtcZd7E/S/BRPl0nXg=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:04.152127 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-9c5e73f3-4da1-4281-bf85-a515116de0c2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Getting quotas for project 8ede055158e24b7c9a935b833e33b89a. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:28:04.156747 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-9c5e73f3-4da1-4281-bf85-a515116de0c2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Getting quotas for user dc2bbdceb12641e6a0595e68f7cefd63 and project 8ede055158e24b7c9a935b833e33b89a. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:28:04.189218 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9c5e73f3-4da1-4281-bf85-a515116de0c2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.067942 Aug 19 15:28:04.190502 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 287/562] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Aug 19 15:28:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:06.297247 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6bce345b-5d31-4f91-b9ef-2fe7b09c360d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1541382610", "imageRef": "27174b76-85e7-4123-a2bc-847959ca59f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "686c1d24-9be3-4e13-8a5a-a63e7258a1fc"}], "security_groups": [{"name": "tempest-securitygroup--1705487924"}], "key_name": "tempest-keypair-1419104470", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:06.482737 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-6bce345b-5d31-4f91-b9ef-2fe7b09c360d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] validate_networks() for [('686c1d24-9be3-4e13-8a5a-a63e7258a1fc', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:28:06.977292 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-6bce345b-5d31-4f91-b9ef-2fe7b09c360d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:28:06.977714 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-6bce345b-5d31-4f91-b9ef-2fe7b09c360d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:28:06.978174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-6bce345b-5d31-4f91-b9ef-2fe7b09c360d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:28:06.978574 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-6bce345b-5d31-4f91-b9ef-2fe7b09c360d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:28:06.978976 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-6bce345b-5d31-4f91-b9ef-2fe7b09c360d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:28:06.995550 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bce345b-5d31-4f91-b9ef-2fe7b09c360d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:06.997347 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bce345b-5d31-4f91-b9ef-2fe7b09c360d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:06.998939 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bce345b-5d31-4f91-b9ef-2fe7b09c360d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:06.999674 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bce345b-5d31-4f91-b9ef-2fe7b09c360d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:07.000224 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bce345b-5d31-4f91-b9ef-2fe7b09c360d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:07.000758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bce345b-5d31-4f91-b9ef-2fe7b09c360d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:07.027547 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-6bce345b-5d31-4f91-b9ef-2fe7b09c360d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Getting quotas for project 8ede055158e24b7c9a935b833e33b89a. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:28:07.032774 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-6bce345b-5d31-4f91-b9ef-2fe7b09c360d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Getting quotas for user dc2bbdceb12641e6a0595e68f7cefd63 and project 8ede055158e24b7c9a935b833e33b89a. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:28:07.049847 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6bce345b-5d31-4f91-b9ef-2fe7b09c360d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:28:07.052313 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6bce345b-5d31-4f91-b9ef-2fe7b09c360d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27174b76-85e7-4123-a2bc-847959ca59f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:28:07.109117 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6bce345b-5d31-4f91-b9ef-2fe7b09c360d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.817558 Aug 19 15:28:07.109763 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 276/563] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:28:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 15:28:07.123317 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aff99d05-0e62-4523-9ef1-4deea4d6d64b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:07.123928 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aff99d05-0e62-4523-9ef1-4deea4d6d64b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:07.209319 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-aff99d05-0e62-4523-9ef1-4deea4d6d64b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:07.217422 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aff99d05-0e62-4523-9ef1-4deea4d6d64b tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1238 microversion: 2.1 time: 0.098721 Aug 19 15:28:07.218181 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 288/564] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:07 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1238 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:08.243706 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3fdab661-458f-4551-94d7-925de49a0012 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:08.244938 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3fdab661-458f-4551-94d7-925de49a0012 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:08.253676 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fdab661-458f-4551-94d7-925de49a0012 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:08.254467 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fdab661-458f-4551-94d7-925de49a0012 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:08.255057 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fdab661-458f-4551-94d7-925de49a0012 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:08.255915 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fdab661-458f-4551-94d7-925de49a0012 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:08.256542 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fdab661-458f-4551-94d7-925de49a0012 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:08.257149 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fdab661-458f-4551-94d7-925de49a0012 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:08.330183 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3fdab661-458f-4551-94d7-925de49a0012 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:08.339613 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3fdab661-458f-4551-94d7-925de49a0012 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1290 microversion: 2.1 time: 0.100585 Aug 19 15:28:08.353255 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 277/565] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:08 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1290 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:09.361391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-73e7c33a-1a38-4c62-a0bc-c0692aa3bc4f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:09.361996 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-73e7c33a-1a38-4c62-a0bc-c0692aa3bc4f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:09.369929 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73e7c33a-1a38-4c62-a0bc-c0692aa3bc4f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:09.370457 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73e7c33a-1a38-4c62-a0bc-c0692aa3bc4f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:09.370905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73e7c33a-1a38-4c62-a0bc-c0692aa3bc4f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:09.371733 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73e7c33a-1a38-4c62-a0bc-c0692aa3bc4f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:09.372279 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73e7c33a-1a38-4c62-a0bc-c0692aa3bc4f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:09.372807 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73e7c33a-1a38-4c62-a0bc-c0692aa3bc4f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:09.554726 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-73e7c33a-1a38-4c62-a0bc-c0692aa3bc4f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:09.578138 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-73e7c33a-1a38-4c62-a0bc-c0692aa3bc4f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1364 microversion: 2.1 time: 0.219929 Aug 19 15:28:09.579080 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 289/566] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:09 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:10.270681 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-6fa28d90-4082-4801-ac21-2e19a4dfb6b3 req-593e9c2a-0b5f-4e7f-be5b-bda25011ce9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b74c1b-5e8f-463a-9b8d-f500e8a70ca6", "tag": "a5f5d004-834d-4100-8eed-8e19902d8987"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:10.290921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-6fa28d90-4082-4801-ac21-2e19a4dfb6b3 req-593e9c2a-0b5f-4e7f-be5b-bda25011ce9c service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:10.292027 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-6fa28d90-4082-4801-ac21-2e19a4dfb6b3 req-593e9c2a-0b5f-4e7f-be5b-bda25011ce9c service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:10.292793 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-6fa28d90-4082-4801-ac21-2e19a4dfb6b3 req-593e9c2a-0b5f-4e7f-be5b-bda25011ce9c service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:10.311402 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-6fa28d90-4082-4801-ac21-2e19a4dfb6b3 req-593e9c2a-0b5f-4e7f-be5b-bda25011ce9c service nova] Creating event network-changed:a5f5d004-834d-4100-8eed-8e19902d8987 for instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 on hv-cinder-83538 Aug 19 15:28:10.321793 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-6fa28d90-4082-4801-ac21-2e19a4dfb6b3 req-593e9c2a-0b5f-4e7f-be5b-bda25011ce9c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058935 Aug 19 15:28:10.323059 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 278/567] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:10.600442 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c49ddc79-1ef5-4952-a84d-930f5e888aa7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:10.601157 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c49ddc79-1ef5-4952-a84d-930f5e888aa7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:10.603949 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:10.610334 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c49ddc79-1ef5-4952-a84d-930f5e888aa7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:10.611243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c49ddc79-1ef5-4952-a84d-930f5e888aa7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:10.612596 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c49ddc79-1ef5-4952-a84d-930f5e888aa7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:10.613658 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c49ddc79-1ef5-4952-a84d-930f5e888aa7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:10.614333 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c49ddc79-1ef5-4952-a84d-930f5e888aa7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:10.614982 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c49ddc79-1ef5-4952-a84d-930f5e888aa7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:10.795205 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c49ddc79-1ef5-4952-a84d-930f5e888aa7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:10.807168 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c49ddc79-1ef5-4952-a84d-930f5e888aa7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1364 microversion: 2.1 time: 0.210009 Aug 19 15:28:10.808184 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 290/568] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:10 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:11.900100 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ddc1f119-0f27-492d-8c74-7a61d176d5d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:11.901481 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ddc1f119-0f27-492d-8c74-7a61d176d5d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:11.908707 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddc1f119-0f27-492d-8c74-7a61d176d5d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:11.909382 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddc1f119-0f27-492d-8c74-7a61d176d5d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:11.910254 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddc1f119-0f27-492d-8c74-7a61d176d5d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:11.911110 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddc1f119-0f27-492d-8c74-7a61d176d5d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:11.911553 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddc1f119-0f27-492d-8c74-7a61d176d5d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:11.911969 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddc1f119-0f27-492d-8c74-7a61d176d5d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:12.073384 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ddc1f119-0f27-492d-8c74-7a61d176d5d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:12.078362 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=79 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:12.084089 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ddc1f119-0f27-492d-8c74-7a61d176d5d9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1364 microversion: 2.1 time: 0.255877 Aug 19 15:28:12.097157 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 279/569] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:11 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1364 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:13.111365 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f3838b52-c1ad-4a2f-a3e6-eb0af7273311 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:13.112280 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f3838b52-c1ad-4a2f-a3e6-eb0af7273311 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:13.119625 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3838b52-c1ad-4a2f-a3e6-eb0af7273311 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:13.120363 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3838b52-c1ad-4a2f-a3e6-eb0af7273311 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:13.120976 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3838b52-c1ad-4a2f-a3e6-eb0af7273311 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:13.122796 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3838b52-c1ad-4a2f-a3e6-eb0af7273311 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:13.123531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3838b52-c1ad-4a2f-a3e6-eb0af7273311 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:13.124129 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3838b52-c1ad-4a2f-a3e6-eb0af7273311 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:13.268184 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f3838b52-c1ad-4a2f-a3e6-eb0af7273311 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:13.276543 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f3838b52-c1ad-4a2f-a3e6-eb0af7273311 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1364 microversion: 2.1 time: 0.171340 Aug 19 15:28:13.277123 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 291/570] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:13 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:13.374558 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5344554d-2ae5-435e-934f-a8a6e0c20384 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Action: 'create', calling method: .version_select at 0x7fb53345a9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1851561349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8hwI4Mkt1RWnLWtD/q3/L3R4IA/XQyqJZ2DLbhCTmVuzOAmPmJuwhQlkI9aVAgKMrjvtjn2So2BUOiXrSklVMe5kW/xgrFi5/2GXzn3D9ly4U1DSQzGtbOrpUvdvRMAg=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:13.390708 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-5344554d-2ae5-435e-934f-a8a6e0c20384 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Getting quotas for project 3c3e603ab69848a2b9688f1e536017f3. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:28:13.395715 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-5344554d-2ae5-435e-934f-a8a6e0c20384 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Getting quotas for user 48b7030c933c4e6a92711b35cd6f9685 and project 3c3e603ab69848a2b9688f1e536017f3. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:28:13.419471 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5344554d-2ae5-435e-934f-a8a6e0c20384 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050175 Aug 19 15:28:13.420063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 280/571] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Aug 19 15:28:13 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:13.471976 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4d9c5fb8-ebca-4346-881e-ff8c5b877ffa tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-321313361", "imageRef": "337c0ffe-8aed-446e-9601-51d99b03c54d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1851561349", "networks": [{"uuid": "6984f544-3e69-4348-a7eb-5484342f7b48"}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:13.524009 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-4d9c5fb8-ebca-4346-881e-ff8c5b877ffa tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] validate_networks() for [('6984f544-3e69-4348-a7eb-5484342f7b48', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:28:13.903844 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-4d9c5fb8-ebca-4346-881e-ff8c5b877ffa tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:28:13.904328 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-4d9c5fb8-ebca-4346-881e-ff8c5b877ffa tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:28:13.904931 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-4d9c5fb8-ebca-4346-881e-ff8c5b877ffa tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:28:13.905433 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-4d9c5fb8-ebca-4346-881e-ff8c5b877ffa tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:28:13.905953 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-4d9c5fb8-ebca-4346-881e-ff8c5b877ffa tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:28:13.915317 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d9c5fb8-ebca-4346-881e-ff8c5b877ffa tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:13.915859 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d9c5fb8-ebca-4346-881e-ff8c5b877ffa tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:13.916412 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d9c5fb8-ebca-4346-881e-ff8c5b877ffa tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:13.917204 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d9c5fb8-ebca-4346-881e-ff8c5b877ffa tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:13.917726 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d9c5fb8-ebca-4346-881e-ff8c5b877ffa tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:13.918717 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d9c5fb8-ebca-4346-881e-ff8c5b877ffa tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:13.937260 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-4d9c5fb8-ebca-4346-881e-ff8c5b877ffa tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Getting quotas for project 3c3e603ab69848a2b9688f1e536017f3. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:28:13.941355 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-4d9c5fb8-ebca-4346-881e-ff8c5b877ffa tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Getting quotas for user 48b7030c933c4e6a92711b35cd6f9685 and project 3c3e603ab69848a2b9688f1e536017f3. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:28:13.954608 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4d9c5fb8-ebca-4346-881e-ff8c5b877ffa tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:28:13.956894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4d9c5fb8-ebca-4346-881e-ff8c5b877ffa tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='337c0ffe-8aed-446e-9601-51d99b03c54d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:28:14.007912 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4d9c5fb8-ebca-4346-881e-ff8c5b877ffa tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539666 Aug 19 15:28:14.013958 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 292/572] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:28:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 15:28:14.020413 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-07aa3694-9726-40a7-9689-9103961e4b0d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:14.021212 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-07aa3694-9726-40a7-9689-9103961e4b0d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:14.083873 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-07aa3694-9726-40a7-9689-9103961e4b0d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:14.092825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-07aa3694-9726-40a7-9689-9103961e4b0d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1258 microversion: 2.1 time: 0.076909 Aug 19 15:28:14.094141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 281/573] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:14 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:28:14.301250 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c8452cda-ddab-414d-a6d8-92eb4227ff2d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:14.302445 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c8452cda-ddab-414d-a6d8-92eb4227ff2d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:14.310471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8452cda-ddab-414d-a6d8-92eb4227ff2d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:14.311280 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8452cda-ddab-414d-a6d8-92eb4227ff2d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:14.311713 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8452cda-ddab-414d-a6d8-92eb4227ff2d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:14.312443 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8452cda-ddab-414d-a6d8-92eb4227ff2d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:14.312954 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8452cda-ddab-414d-a6d8-92eb4227ff2d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:14.313424 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8452cda-ddab-414d-a6d8-92eb4227ff2d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:14.462598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c8452cda-ddab-414d-a6d8-92eb4227ff2d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:14.472962 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c8452cda-ddab-414d-a6d8-92eb4227ff2d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1364 microversion: 2.1 time: 0.178587 Aug 19 15:28:14.473586 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 293/574] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:14 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:15.115468 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e0d295ba-2ed8-46aa-af92-0ad79dd71a7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:15.116089 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e0d295ba-2ed8-46aa-af92-0ad79dd71a7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:15.124659 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0d295ba-2ed8-46aa-af92-0ad79dd71a7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:15.125277 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0d295ba-2ed8-46aa-af92-0ad79dd71a7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:15.125818 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0d295ba-2ed8-46aa-af92-0ad79dd71a7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:15.126596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0d295ba-2ed8-46aa-af92-0ad79dd71a7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:15.127119 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0d295ba-2ed8-46aa-af92-0ad79dd71a7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:15.127612 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0d295ba-2ed8-46aa-af92-0ad79dd71a7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:15.200126 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e0d295ba-2ed8-46aa-af92-0ad79dd71a7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:15.208619 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e0d295ba-2ed8-46aa-af92-0ad79dd71a7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1318 microversion: 2.1 time: 0.097230 Aug 19 15:28:15.209322 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 282/575] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:15 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1318 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:15.494995 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9d0b0d12-5a6d-4719-a70c-991662b0392e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:15.495594 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9d0b0d12-5a6d-4719-a70c-991662b0392e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:15.515980 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d0b0d12-5a6d-4719-a70c-991662b0392e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:15.516500 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d0b0d12-5a6d-4719-a70c-991662b0392e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:15.517029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d0b0d12-5a6d-4719-a70c-991662b0392e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:15.517866 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d0b0d12-5a6d-4719-a70c-991662b0392e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:15.518353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d0b0d12-5a6d-4719-a70c-991662b0392e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:15.518845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d0b0d12-5a6d-4719-a70c-991662b0392e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:15.703578 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d0b0d12-5a6d-4719-a70c-991662b0392e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:15.712666 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9d0b0d12-5a6d-4719-a70c-991662b0392e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1364 microversion: 2.1 time: 0.221327 Aug 19 15:28:15.713583 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 294/576] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:15 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:16.193306 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-f872a40d-b188-4e77-8240-abb9c26bd62b req-fcb554d3-824f-43ba-bae4-964539e4db18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b74c1b-5e8f-463a-9b8d-f500e8a70ca6", "name": "network-vif-plugged", "status": "completed", "tag": "a5f5d004-834d-4100-8eed-8e19902d8987"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:16.219616 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f872a40d-b188-4e77-8240-abb9c26bd62b req-fcb554d3-824f-43ba-bae4-964539e4db18 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:16.221822 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f872a40d-b188-4e77-8240-abb9c26bd62b req-fcb554d3-824f-43ba-bae4-964539e4db18 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:16.223866 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f872a40d-b188-4e77-8240-abb9c26bd62b req-fcb554d3-824f-43ba-bae4-964539e4db18 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:16.244927 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ecf7994a-99b0-4d02-9e60-5fbd32ae2e5c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:16.245932 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ecf7994a-99b0-4d02-9e60-5fbd32ae2e5c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:16.258360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ecf7994a-99b0-4d02-9e60-5fbd32ae2e5c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:16.259048 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-f872a40d-b188-4e77-8240-abb9c26bd62b req-fcb554d3-824f-43ba-bae4-964539e4db18 service nova] Creating event network-vif-plugged:a5f5d004-834d-4100-8eed-8e19902d8987 for instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 on hv-cinder-83538 Aug 19 15:28:16.263231 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ecf7994a-99b0-4d02-9e60-5fbd32ae2e5c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:16.264028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ecf7994a-99b0-4d02-9e60-5fbd32ae2e5c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:16.267389 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ecf7994a-99b0-4d02-9e60-5fbd32ae2e5c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:16.268121 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ecf7994a-99b0-4d02-9e60-5fbd32ae2e5c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:16.268796 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ecf7994a-99b0-4d02-9e60-5fbd32ae2e5c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:16.277031 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-f872a40d-b188-4e77-8240-abb9c26bd62b req-fcb554d3-824f-43ba-bae4-964539e4db18 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088174 Aug 19 15:28:16.277865 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 283/577] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:28:16.486461 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ecf7994a-99b0-4d02-9e60-5fbd32ae2e5c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:16.494240 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ecf7994a-99b0-4d02-9e60-5fbd32ae2e5c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1358 microversion: 2.1 time: 0.266534 Aug 19 15:28:16.494817 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 295/578] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:16 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:28:16.735031 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2e9f30e3-dab8-4c71-80ba-0c8468a53479 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:16.735626 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2e9f30e3-dab8-4c71-80ba-0c8468a53479 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:16.742209 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e9f30e3-dab8-4c71-80ba-0c8468a53479 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:16.742698 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e9f30e3-dab8-4c71-80ba-0c8468a53479 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:16.743134 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e9f30e3-dab8-4c71-80ba-0c8468a53479 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:16.743863 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e9f30e3-dab8-4c71-80ba-0c8468a53479 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:16.744318 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e9f30e3-dab8-4c71-80ba-0c8468a53479 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:16.744775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e9f30e3-dab8-4c71-80ba-0c8468a53479 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:16.915010 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2e9f30e3-dab8-4c71-80ba-0c8468a53479 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:16.927055 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2e9f30e3-dab8-4c71-80ba-0c8468a53479 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1364 microversion: 2.1 time: 0.196436 Aug 19 15:28:16.928354 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 284/579] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:16 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:17.516640 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-35ae0256-4b6e-4254-9ef7-6d11104de417 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:17.517367 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-35ae0256-4b6e-4254-9ef7-6d11104de417 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:17.524037 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35ae0256-4b6e-4254-9ef7-6d11104de417 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:17.524623 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35ae0256-4b6e-4254-9ef7-6d11104de417 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:17.525114 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35ae0256-4b6e-4254-9ef7-6d11104de417 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:17.525887 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35ae0256-4b6e-4254-9ef7-6d11104de417 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:17.526397 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35ae0256-4b6e-4254-9ef7-6d11104de417 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:17.526880 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35ae0256-4b6e-4254-9ef7-6d11104de417 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:17.738444 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-35ae0256-4b6e-4254-9ef7-6d11104de417 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:17.750263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-35ae0256-4b6e-4254-9ef7-6d11104de417 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1358 microversion: 2.1 time: 0.238072 Aug 19 15:28:17.751164 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 296/580] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:17 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:17.948562 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f441cad7-560e-4901-bce6-1f92dc090f7d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:17.950351 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f441cad7-560e-4901-bce6-1f92dc090f7d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:17.952660 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:17.954042 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:17.960073 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f441cad7-560e-4901-bce6-1f92dc090f7d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:17.960814 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f441cad7-560e-4901-bce6-1f92dc090f7d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:17.961247 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f441cad7-560e-4901-bce6-1f92dc090f7d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:17.961943 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f441cad7-560e-4901-bce6-1f92dc090f7d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:17.962394 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f441cad7-560e-4901-bce6-1f92dc090f7d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:17.962811 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f441cad7-560e-4901-bce6-1f92dc090f7d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:18.118560 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f441cad7-560e-4901-bce6-1f92dc090f7d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:18.128301 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f441cad7-560e-4901-bce6-1f92dc090f7d tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1364 microversion: 2.1 time: 0.183407 Aug 19 15:28:18.128927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 285/581] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:17 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:18.771186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-955637a2-11b8-465d-a08e-37f6b171f1bf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:18.771920 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-955637a2-11b8-465d-a08e-37f6b171f1bf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:18.780261 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-955637a2-11b8-465d-a08e-37f6b171f1bf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:18.780775 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-955637a2-11b8-465d-a08e-37f6b171f1bf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:18.781205 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-955637a2-11b8-465d-a08e-37f6b171f1bf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:18.781906 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-955637a2-11b8-465d-a08e-37f6b171f1bf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:18.782358 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-955637a2-11b8-465d-a08e-37f6b171f1bf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:18.782785 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-955637a2-11b8-465d-a08e-37f6b171f1bf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:18.940694 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-955637a2-11b8-465d-a08e-37f6b171f1bf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:18.952825 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-955637a2-11b8-465d-a08e-37f6b171f1bf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1358 microversion: 2.1 time: 0.186255 Aug 19 15:28:18.953607 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 297/582] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:18 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:19.151113 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-404e5118-606b-4d5d-8c37-0b327cd202ba tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:19.151711 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-404e5118-606b-4d5d-8c37-0b327cd202ba tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:19.158432 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-404e5118-606b-4d5d-8c37-0b327cd202ba tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:19.158919 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-404e5118-606b-4d5d-8c37-0b327cd202ba tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:19.159364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-404e5118-606b-4d5d-8c37-0b327cd202ba tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:19.160073 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-404e5118-606b-4d5d-8c37-0b327cd202ba tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:19.160560 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-404e5118-606b-4d5d-8c37-0b327cd202ba tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:19.160988 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-404e5118-606b-4d5d-8c37-0b327cd202ba tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:19.312195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-404e5118-606b-4d5d-8c37-0b327cd202ba tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:19.320581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-404e5118-606b-4d5d-8c37-0b327cd202ba tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1364 microversion: 2.1 time: 0.173254 Aug 19 15:28:19.321478 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 286/583] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:19 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:19.973855 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-43b751c5-e7b1-4277-a80a-11a5aed63cb6 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:19.974451 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-43b751c5-e7b1-4277-a80a-11a5aed63cb6 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:19.982336 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43b751c5-e7b1-4277-a80a-11a5aed63cb6 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:19.982829 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43b751c5-e7b1-4277-a80a-11a5aed63cb6 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:19.983271 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43b751c5-e7b1-4277-a80a-11a5aed63cb6 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:19.984049 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43b751c5-e7b1-4277-a80a-11a5aed63cb6 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:19.984792 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43b751c5-e7b1-4277-a80a-11a5aed63cb6 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:19.985218 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43b751c5-e7b1-4277-a80a-11a5aed63cb6 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:20.143672 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-43b751c5-e7b1-4277-a80a-11a5aed63cb6 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:20.157122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-43b751c5-e7b1-4277-a80a-11a5aed63cb6 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1358 microversion: 2.1 time: 0.187098 Aug 19 15:28:20.157725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 298/584] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:19 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:20.349575 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-48154d7b-0f6c-4e63-95d5-06caabe1fc28 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:20.351045 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-48154d7b-0f6c-4e63-95d5-06caabe1fc28 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:20.359281 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48154d7b-0f6c-4e63-95d5-06caabe1fc28 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:20.359777 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48154d7b-0f6c-4e63-95d5-06caabe1fc28 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:20.360279 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48154d7b-0f6c-4e63-95d5-06caabe1fc28 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:20.361159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48154d7b-0f6c-4e63-95d5-06caabe1fc28 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:20.361605 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48154d7b-0f6c-4e63-95d5-06caabe1fc28 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:20.362061 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48154d7b-0f6c-4e63-95d5-06caabe1fc28 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:20.534778 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-48154d7b-0f6c-4e63-95d5-06caabe1fc28 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:20.550152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-48154d7b-0f6c-4e63-95d5-06caabe1fc28 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1364 microversion: 2.1 time: 0.204832 Aug 19 15:28:20.551273 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 287/585] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:20 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:21.178818 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8e8ca4a5-6c09-4b80-a2eb-04d7d28607e1 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:21.179597 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8e8ca4a5-6c09-4b80-a2eb-04d7d28607e1 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:21.187475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e8ca4a5-6c09-4b80-a2eb-04d7d28607e1 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:21.188144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e8ca4a5-6c09-4b80-a2eb-04d7d28607e1 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:21.188718 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e8ca4a5-6c09-4b80-a2eb-04d7d28607e1 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:21.190177 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e8ca4a5-6c09-4b80-a2eb-04d7d28607e1 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:21.190693 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e8ca4a5-6c09-4b80-a2eb-04d7d28607e1 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:21.191133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e8ca4a5-6c09-4b80-a2eb-04d7d28607e1 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:21.331002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8e8ca4a5-6c09-4b80-a2eb-04d7d28607e1 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:21.339561 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8e8ca4a5-6c09-4b80-a2eb-04d7d28607e1 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1358 microversion: 2.1 time: 0.164509 Aug 19 15:28:21.340608 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 299/586] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:21 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:21.571274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-beeccd85-9359-475a-8689-7b95f51086f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:21.571963 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-beeccd85-9359-475a-8689-7b95f51086f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:21.578649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-beeccd85-9359-475a-8689-7b95f51086f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:21.579133 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-beeccd85-9359-475a-8689-7b95f51086f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:21.579556 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-beeccd85-9359-475a-8689-7b95f51086f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:21.580242 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-beeccd85-9359-475a-8689-7b95f51086f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:21.580718 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-beeccd85-9359-475a-8689-7b95f51086f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:21.581132 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-beeccd85-9359-475a-8689-7b95f51086f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:21.733343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-beeccd85-9359-475a-8689-7b95f51086f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:21.741243 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-beeccd85-9359-475a-8689-7b95f51086f6 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1364 microversion: 2.1 time: 0.173850 Aug 19 15:28:21.742056 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 288/587] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:21 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:28:22.361879 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7079d498-6e26-405a-a48e-a1e8bfe9f9c7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:22.362664 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7079d498-6e26-405a-a48e-a1e8bfe9f9c7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:22.369897 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7079d498-6e26-405a-a48e-a1e8bfe9f9c7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:22.370396 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7079d498-6e26-405a-a48e-a1e8bfe9f9c7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:22.370825 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7079d498-6e26-405a-a48e-a1e8bfe9f9c7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:22.372480 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7079d498-6e26-405a-a48e-a1e8bfe9f9c7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:22.373050 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7079d498-6e26-405a-a48e-a1e8bfe9f9c7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:22.373460 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7079d498-6e26-405a-a48e-a1e8bfe9f9c7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:22.509687 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7079d498-6e26-405a-a48e-a1e8bfe9f9c7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:22.519344 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7079d498-6e26-405a-a48e-a1e8bfe9f9c7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1358 microversion: 2.1 time: 0.161455 Aug 19 15:28:22.523342 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 300/588] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:22 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:22.767880 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-43f4cbca-b789-4392-8453-c9ce9d51c001 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:22.769187 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-43f4cbca-b789-4392-8453-c9ce9d51c001 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:22.778014 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43f4cbca-b789-4392-8453-c9ce9d51c001 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:22.778502 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43f4cbca-b789-4392-8453-c9ce9d51c001 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:22.778941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43f4cbca-b789-4392-8453-c9ce9d51c001 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:22.780478 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43f4cbca-b789-4392-8453-c9ce9d51c001 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:22.780802 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43f4cbca-b789-4392-8453-c9ce9d51c001 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:22.781255 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43f4cbca-b789-4392-8453-c9ce9d51c001 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:22.924440 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-43f4cbca-b789-4392-8453-c9ce9d51c001 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:22.934244 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-43f4cbca-b789-4392-8453-c9ce9d51c001 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1364 microversion: 2.1 time: 0.174061 Aug 19 15:28:22.934721 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 289/589] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:22 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:23.149874 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0f40eaa7-f2d1-4e4d-99e8-4926213e7d6b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:23.150694 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0f40eaa7-f2d1-4e4d-99e8-4926213e7d6b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:23.158278 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f40eaa7-f2d1-4e4d-99e8-4926213e7d6b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:23.159223 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f40eaa7-f2d1-4e4d-99e8-4926213e7d6b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:23.159889 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f40eaa7-f2d1-4e4d-99e8-4926213e7d6b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:23.160834 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f40eaa7-f2d1-4e4d-99e8-4926213e7d6b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:23.161475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f40eaa7-f2d1-4e4d-99e8-4926213e7d6b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:23.162329 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f40eaa7-f2d1-4e4d-99e8-4926213e7d6b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:23.190778 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0f40eaa7-f2d1-4e4d-99e8-4926213e7d6b tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/ips" status: 200 len: 150 microversion: 2.1 time: 0.169249 Aug 19 15:28:23.191425 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 301/590] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Aug 19 15:28:23 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/ips => generated 150 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:28:23.547810 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-da5c31ed-2773-48cb-a9db-6c3e9e31fb73 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:23.549058 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-da5c31ed-2773-48cb-a9db-6c3e9e31fb73 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:23.557651 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da5c31ed-2773-48cb-a9db-6c3e9e31fb73 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:23.558636 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da5c31ed-2773-48cb-a9db-6c3e9e31fb73 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:23.559362 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da5c31ed-2773-48cb-a9db-6c3e9e31fb73 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:23.561110 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da5c31ed-2773-48cb-a9db-6c3e9e31fb73 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:23.562072 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da5c31ed-2773-48cb-a9db-6c3e9e31fb73 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:23.563028 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da5c31ed-2773-48cb-a9db-6c3e9e31fb73 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:23.713584 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-da5c31ed-2773-48cb-a9db-6c3e9e31fb73 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:23.722784 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-da5c31ed-2773-48cb-a9db-6c3e9e31fb73 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1358 microversion: 2.1 time: 0.180763 Aug 19 15:28:23.723575 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 290/591] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:23 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:23.955847 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-433589db-98ff-46cb-88ad-f69bb2ae379c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:23.956714 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-433589db-98ff-46cb-88ad-f69bb2ae379c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:23.959159 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:23.959834 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=12 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:23.966574 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-433589db-98ff-46cb-88ad-f69bb2ae379c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:23.967653 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-433589db-98ff-46cb-88ad-f69bb2ae379c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:23.968124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-433589db-98ff-46cb-88ad-f69bb2ae379c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:23.970519 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-433589db-98ff-46cb-88ad-f69bb2ae379c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:23.970519 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-433589db-98ff-46cb-88ad-f69bb2ae379c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:23.970519 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-433589db-98ff-46cb-88ad-f69bb2ae379c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:24.126072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-433589db-98ff-46cb-88ad-f69bb2ae379c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:24.134120 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-433589db-98ff-46cb-88ad-f69bb2ae379c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1364 microversion: 2.1 time: 0.182746 Aug 19 15:28:24.134692 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 302/592] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:23 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:24.564744 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9013a67a-37e3-4109-b8d7-cb15671ab84f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ee38767-9f57-4a49-91dd-536f890755e9"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:24.567273 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9013a67a-37e3-4109-b8d7-cb15671ab84f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:24.569733 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=12 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:24.578871 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9013a67a-37e3-4109-b8d7-cb15671ab84f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:24.579362 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9013a67a-37e3-4109-b8d7-cb15671ab84f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:24.579795 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9013a67a-37e3-4109-b8d7-cb15671ab84f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:24.580546 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9013a67a-37e3-4109-b8d7-cb15671ab84f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:24.581001 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9013a67a-37e3-4109-b8d7-cb15671ab84f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:24.581702 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9013a67a-37e3-4109-b8d7-cb15671ab84f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:24.749257 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5dcde0b8-541e-4868-a79b-50dc750b0c67 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:24.749896 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5dcde0b8-541e-4868-a79b-50dc750b0c67 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:24.757176 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dcde0b8-541e-4868-a79b-50dc750b0c67 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:24.757745 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dcde0b8-541e-4868-a79b-50dc750b0c67 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:24.758245 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dcde0b8-541e-4868-a79b-50dc750b0c67 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:24.759146 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dcde0b8-541e-4868-a79b-50dc750b0c67 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:24.759941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dcde0b8-541e-4868-a79b-50dc750b0c67 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:24.761197 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5dcde0b8-541e-4868-a79b-50dc750b0c67 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:24.780759 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:24.873580 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9013a67a-37e3-4109-b8d7-cb15671ab84f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "POST /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313016 Aug 19 15:28:24.874919 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 291/593] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Aug 19 15:28:24 2022] POST /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:24.927360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5dcde0b8-541e-4868-a79b-50dc750b0c67 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:24.936685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5dcde0b8-541e-4868-a79b-50dc750b0c67 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1358 microversion: 2.1 time: 0.192065 Aug 19 15:28:24.937828 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 303/594] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:24 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:28:25.159498 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6d388d79-8182-4293-98c8-7498d91314ea tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:25.160195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6d388d79-8182-4293-98c8-7498d91314ea tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:25.166502 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d388d79-8182-4293-98c8-7498d91314ea tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:25.167084 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d388d79-8182-4293-98c8-7498d91314ea tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:25.167519 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d388d79-8182-4293-98c8-7498d91314ea tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:25.168310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d388d79-8182-4293-98c8-7498d91314ea tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:25.168661 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d388d79-8182-4293-98c8-7498d91314ea tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:25.168987 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d388d79-8182-4293-98c8-7498d91314ea tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:25.271000 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-4da97055-5e68-4426-9a3f-72cc48048151 req-03b5de4a-3c28-4a5f-86b8-7e6ab7b65c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc81caa-949a-42ac-b696-7bb7cb9c5fd5", "tag": "8e0d422a-3a6d-4e22-8237-a99f06f45464"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:25.286394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4da97055-5e68-4426-9a3f-72cc48048151 req-03b5de4a-3c28-4a5f-86b8-7e6ab7b65c6a service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:25.286394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4da97055-5e68-4426-9a3f-72cc48048151 req-03b5de4a-3c28-4a5f-86b8-7e6ab7b65c6a service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:25.287043 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4da97055-5e68-4426-9a3f-72cc48048151 req-03b5de4a-3c28-4a5f-86b8-7e6ab7b65c6a service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:25.313617 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-4da97055-5e68-4426-9a3f-72cc48048151 req-03b5de4a-3c28-4a5f-86b8-7e6ab7b65c6a service nova] Creating event network-changed:8e0d422a-3a6d-4e22-8237-a99f06f45464 for instance 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 on hv-cinder-83538 Aug 19 15:28:25.319394 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-4da97055-5e68-4426-9a3f-72cc48048151 req-03b5de4a-3c28-4a5f-86b8-7e6ab7b65c6a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052123 Aug 19 15:28:25.320646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 304/595] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:28:25.361253 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6d388d79-8182-4293-98c8-7498d91314ea tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:25.369905 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6d388d79-8182-4293-98c8-7498d91314ea tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1364 microversion: 2.1 time: 0.216347 Aug 19 15:28:25.370734 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 292/596] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:25 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:28:25.957777 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d7f56ed1-72d6-475e-832e-0150d60d2d0c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:25.958539 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d7f56ed1-72d6-475e-832e-0150d60d2d0c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:25.964831 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7f56ed1-72d6-475e-832e-0150d60d2d0c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:25.965318 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7f56ed1-72d6-475e-832e-0150d60d2d0c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:25.965754 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7f56ed1-72d6-475e-832e-0150d60d2d0c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:25.966459 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7f56ed1-72d6-475e-832e-0150d60d2d0c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:25.967545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7f56ed1-72d6-475e-832e-0150d60d2d0c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:25.967974 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7f56ed1-72d6-475e-832e-0150d60d2d0c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:26.109867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d7f56ed1-72d6-475e-832e-0150d60d2d0c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:26.118121 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d7f56ed1-72d6-475e-832e-0150d60d2d0c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1358 microversion: 2.1 time: 0.164582 Aug 19 15:28:26.118685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 305/597] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:25 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:26.391057 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e05fff93-62a1-4efe-bbc2-afab00b5e56a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:26.391600 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e05fff93-62a1-4efe-bbc2-afab00b5e56a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:26.397980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e05fff93-62a1-4efe-bbc2-afab00b5e56a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:26.398747 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e05fff93-62a1-4efe-bbc2-afab00b5e56a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:26.399177 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e05fff93-62a1-4efe-bbc2-afab00b5e56a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:26.399887 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e05fff93-62a1-4efe-bbc2-afab00b5e56a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:26.400339 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e05fff93-62a1-4efe-bbc2-afab00b5e56a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:26.400770 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e05fff93-62a1-4efe-bbc2-afab00b5e56a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:26.539516 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e05fff93-62a1-4efe-bbc2-afab00b5e56a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:26.548658 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e05fff93-62a1-4efe-bbc2-afab00b5e56a tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1364 microversion: 2.1 time: 0.161875 Aug 19 15:28:26.549234 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 293/598] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:26 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:27.139935 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f3b2cf79-0e4a-49b4-8819-0ef73471ea52 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:27.140544 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f3b2cf79-0e4a-49b4-8819-0ef73471ea52 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:27.147414 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3b2cf79-0e4a-49b4-8819-0ef73471ea52 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:27.147889 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3b2cf79-0e4a-49b4-8819-0ef73471ea52 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:27.148317 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3b2cf79-0e4a-49b4-8819-0ef73471ea52 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:27.149027 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3b2cf79-0e4a-49b4-8819-0ef73471ea52 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:27.149472 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3b2cf79-0e4a-49b4-8819-0ef73471ea52 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:27.149887 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3b2cf79-0e4a-49b4-8819-0ef73471ea52 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:27.276924 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f3b2cf79-0e4a-49b4-8819-0ef73471ea52 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:27.285201 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f3b2cf79-0e4a-49b4-8819-0ef73471ea52 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1358 microversion: 2.1 time: 0.149936 Aug 19 15:28:27.285755 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 306/599] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:27 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:27.570150 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-25309089-81c0-4547-9797-7895d7b3ef77 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:27.570665 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-25309089-81c0-4547-9797-7895d7b3ef77 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:27.578151 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25309089-81c0-4547-9797-7895d7b3ef77 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:27.578629 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25309089-81c0-4547-9797-7895d7b3ef77 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:27.579054 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25309089-81c0-4547-9797-7895d7b3ef77 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:27.579723 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25309089-81c0-4547-9797-7895d7b3ef77 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:27.580578 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25309089-81c0-4547-9797-7895d7b3ef77 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:27.580999 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25309089-81c0-4547-9797-7895d7b3ef77 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:27.714776 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-25309089-81c0-4547-9797-7895d7b3ef77 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:27.723326 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-25309089-81c0-4547-9797-7895d7b3ef77 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1549 microversion: 2.1 time: 0.157072 Aug 19 15:28:27.723887 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 294/600] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:27 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:27.743282 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-96b9cac9-6b95-47ca-8a17-eaba51c70b56 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:27.743770 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-96b9cac9-6b95-47ca-8a17-eaba51c70b56 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:27.750301 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96b9cac9-6b95-47ca-8a17-eaba51c70b56 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:27.750782 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96b9cac9-6b95-47ca-8a17-eaba51c70b56 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:27.751219 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96b9cac9-6b95-47ca-8a17-eaba51c70b56 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:27.751905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96b9cac9-6b95-47ca-8a17-eaba51c70b56 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:27.752365 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96b9cac9-6b95-47ca-8a17-eaba51c70b56 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:27.752815 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96b9cac9-6b95-47ca-8a17-eaba51c70b56 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:27.832049 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-96b9cac9-6b95-47ca-8a17-eaba51c70b56 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092527 Aug 19 15:28:27.832686 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 307/601] 10.222.0.75 () {58 vars in 1275 bytes} [Fri Aug 19 15:28:27 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:28.306351 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8f4cb7a7-cb71-464b-bc7e-c8989957b30d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:28.307259 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8f4cb7a7-cb71-464b-bc7e-c8989957b30d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:28.314096 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f4cb7a7-cb71-464b-bc7e-c8989957b30d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:28.314583 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f4cb7a7-cb71-464b-bc7e-c8989957b30d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:28.315018 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f4cb7a7-cb71-464b-bc7e-c8989957b30d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:28.315776 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f4cb7a7-cb71-464b-bc7e-c8989957b30d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:28.316233 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f4cb7a7-cb71-464b-bc7e-c8989957b30d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:28.316685 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f4cb7a7-cb71-464b-bc7e-c8989957b30d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:28.549499 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8f4cb7a7-cb71-464b-bc7e-c8989957b30d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:28.557618 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8f4cb7a7-cb71-464b-bc7e-c8989957b30d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1358 microversion: 2.1 time: 0.255069 Aug 19 15:28:28.558317 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 295/602] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:28 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:28.873425 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-2ebc556a-b821-4ef9-b8f6-fdbaf0926716 req-c9094f64-ac4b-4724-b9ac-adf83fe1b82d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b74c1b-5e8f-463a-9b8d-f500e8a70ca6", "tag": "a5f5d004-834d-4100-8eed-8e19902d8987"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:28.883444 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-2ebc556a-b821-4ef9-b8f6-fdbaf0926716 req-c9094f64-ac4b-4724-b9ac-adf83fe1b82d service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:28.884021 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-2ebc556a-b821-4ef9-b8f6-fdbaf0926716 req-c9094f64-ac4b-4724-b9ac-adf83fe1b82d service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:28.884571 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-2ebc556a-b821-4ef9-b8f6-fdbaf0926716 req-c9094f64-ac4b-4724-b9ac-adf83fe1b82d service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:28.897159 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-2ebc556a-b821-4ef9-b8f6-fdbaf0926716 req-c9094f64-ac4b-4724-b9ac-adf83fe1b82d service nova] Creating event network-changed:a5f5d004-834d-4100-8eed-8e19902d8987 for instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 on hv-cinder-83538 Aug 19 15:28:28.902122 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-2ebc556a-b821-4ef9-b8f6-fdbaf0926716 req-c9094f64-ac4b-4724-b9ac-adf83fe1b82d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032876 Aug 19 15:28:28.902996 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 308/603] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:29.433123 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e1c252ed-d575-4f1a-a963-33d0bd4c9eed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:29.433692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e1c252ed-d575-4f1a-a963-33d0bd4c9eed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:29.441367 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1c252ed-d575-4f1a-a963-33d0bd4c9eed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:29.441956 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1c252ed-d575-4f1a-a963-33d0bd4c9eed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:29.442471 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1c252ed-d575-4f1a-a963-33d0bd4c9eed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:29.443403 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1c252ed-d575-4f1a-a963-33d0bd4c9eed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:29.443941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1c252ed-d575-4f1a-a963-33d0bd4c9eed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:29.444463 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1c252ed-d575-4f1a-a963-33d0bd4c9eed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:29.541076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-e1c252ed-d575-4f1a-a963-33d0bd4c9eed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lazy-loading 'services' on Instance uuid c73df7a2-f347-4f80-8853-f5ea25b0cbc7 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:28:29.580708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-53bb4a1f-6218-4030-ab2a-f0b4a8cbd20b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:29.581520 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-53bb4a1f-6218-4030-ab2a-f0b4a8cbd20b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:29.588148 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53bb4a1f-6218-4030-ab2a-f0b4a8cbd20b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:29.588785 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53bb4a1f-6218-4030-ab2a-f0b4a8cbd20b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:29.589465 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53bb4a1f-6218-4030-ab2a-f0b4a8cbd20b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:29.590193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53bb4a1f-6218-4030-ab2a-f0b4a8cbd20b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:29.590994 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53bb4a1f-6218-4030-ab2a-f0b4a8cbd20b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:29.591108 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53bb4a1f-6218-4030-ab2a-f0b4a8cbd20b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:29.622407 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e1c252ed-d575-4f1a-a963-33d0bd4c9eed tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-volume_attachments/aa5eefef-e385-41d6-a000-84c88e4aa67c" status: 202 len: 0 microversion: 2.1 time: 0.193294 Aug 19 15:28:29.624586 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 296/604] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Aug 19 15:28:29 2022] DELETE /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-volume_attachments/aa5eefef-e385-41d6-a000-84c88e4aa67c => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:28:29.633120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fee18056-f980-4e9c-a38a-60e7c9c01e5d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:29.636716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fee18056-f980-4e9c-a38a-60e7c9c01e5d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:29.646013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fee18056-f980-4e9c-a38a-60e7c9c01e5d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:29.646629 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fee18056-f980-4e9c-a38a-60e7c9c01e5d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:29.647136 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fee18056-f980-4e9c-a38a-60e7c9c01e5d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:29.647923 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fee18056-f980-4e9c-a38a-60e7c9c01e5d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:29.648651 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fee18056-f980-4e9c-a38a-60e7c9c01e5d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:29.649178 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fee18056-f980-4e9c-a38a-60e7c9c01e5d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:29.669740 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:29.721716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fee18056-f980-4e9c-a38a-60e7c9c01e5d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093751 Aug 19 15:28:29.722810 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 297/605] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:28:29 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:29.995190 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-53bb4a1f-6218-4030-ab2a-f0b4a8cbd20b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:30.004730 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-53bb4a1f-6218-4030-ab2a-f0b4a8cbd20b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1358 microversion: 2.1 time: 0.429697 Aug 19 15:28:30.005412 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 309/606] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:29 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1358 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:28:30.194292 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-6c54ec36-2314-4d3e-9c0f-9b84cc026ebf req-b7aca7f9-ad78-43e0-8ed4-59edab198431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc81caa-949a-42ac-b696-7bb7cb9c5fd5", "name": "network-vif-plugged", "status": "completed", "tag": "8e0d422a-3a6d-4e22-8237-a99f06f45464"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:30.205357 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-6c54ec36-2314-4d3e-9c0f-9b84cc026ebf req-b7aca7f9-ad78-43e0-8ed4-59edab198431 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:30.205982 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-6c54ec36-2314-4d3e-9c0f-9b84cc026ebf req-b7aca7f9-ad78-43e0-8ed4-59edab198431 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:30.206475 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-6c54ec36-2314-4d3e-9c0f-9b84cc026ebf req-b7aca7f9-ad78-43e0-8ed4-59edab198431 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:30.220659 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-6c54ec36-2314-4d3e-9c0f-9b84cc026ebf req-b7aca7f9-ad78-43e0-8ed4-59edab198431 service nova] Creating event network-vif-plugged:8e0d422a-3a6d-4e22-8237-a99f06f45464 for instance 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 on hv-cinder-83538 Aug 19 15:28:30.235886 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-6c54ec36-2314-4d3e-9c0f-9b84cc026ebf req-b7aca7f9-ad78-43e0-8ed4-59edab198431 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042182 Aug 19 15:28:30.241463 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 298/607] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:30.734922 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-106d9416-9eda-4b1f-9022-033550e7af10 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:30.737121 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-106d9416-9eda-4b1f-9022-033550e7af10 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:30.743829 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-106d9416-9eda-4b1f-9022-033550e7af10 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:30.744315 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-106d9416-9eda-4b1f-9022-033550e7af10 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:30.744770 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-106d9416-9eda-4b1f-9022-033550e7af10 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:30.745476 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-106d9416-9eda-4b1f-9022-033550e7af10 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:30.745924 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-106d9416-9eda-4b1f-9022-033550e7af10 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:30.746343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-106d9416-9eda-4b1f-9022-033550e7af10 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:30.778633 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-106d9416-9eda-4b1f-9022-033550e7af10 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048263 Aug 19 15:28:30.779718 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 310/608] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:28:30 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:31.026980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0040cc40-c507-4096-887b-7612df786815 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:31.027698 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0040cc40-c507-4096-887b-7612df786815 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:31.034783 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0040cc40-c507-4096-887b-7612df786815 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:31.035271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0040cc40-c507-4096-887b-7612df786815 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:31.035704 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0040cc40-c507-4096-887b-7612df786815 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:31.036424 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0040cc40-c507-4096-887b-7612df786815 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:31.036879 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0040cc40-c507-4096-887b-7612df786815 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:31.037342 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0040cc40-c507-4096-887b-7612df786815 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:31.173492 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0040cc40-c507-4096-887b-7612df786815 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:31.181604 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0040cc40-c507-4096-887b-7612df786815 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1358 microversion: 2.1 time: 0.159294 Aug 19 15:28:31.182196 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 299/609] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:31 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:31.791637 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7294d34e-fa7c-4381-8a87-316f7936b440 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:31.793801 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7294d34e-fa7c-4381-8a87-316f7936b440 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:31.804279 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7294d34e-fa7c-4381-8a87-316f7936b440 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:31.804815 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7294d34e-fa7c-4381-8a87-316f7936b440 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:31.805260 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7294d34e-fa7c-4381-8a87-316f7936b440 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:31.806017 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7294d34e-fa7c-4381-8a87-316f7936b440 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:31.806481 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7294d34e-fa7c-4381-8a87-316f7936b440 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:31.806911 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7294d34e-fa7c-4381-8a87-316f7936b440 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:31.840848 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7294d34e-fa7c-4381-8a87-316f7936b440 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053085 Aug 19 15:28:31.841416 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 311/610] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:28:31 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:32.204800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e05e1158-43fb-4a6f-991e-a99b0b76503f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:32.205407 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e05e1158-43fb-4a6f-991e-a99b0b76503f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:32.212053 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e05e1158-43fb-4a6f-991e-a99b0b76503f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:32.212581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e05e1158-43fb-4a6f-991e-a99b0b76503f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:32.213009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e05e1158-43fb-4a6f-991e-a99b0b76503f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:32.213732 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e05e1158-43fb-4a6f-991e-a99b0b76503f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:32.214175 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e05e1158-43fb-4a6f-991e-a99b0b76503f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:32.214587 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e05e1158-43fb-4a6f-991e-a99b0b76503f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:32.363691 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e05e1158-43fb-4a6f-991e-a99b0b76503f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:32.371775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e05e1158-43fb-4a6f-991e-a99b0b76503f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1549 microversion: 2.1 time: 0.172253 Aug 19 15:28:32.372350 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 300/611] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:32 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1549 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:32.391880 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-93875f23-1b87-442b-bacb-be17a5e6548c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:32.392523 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-93875f23-1b87-442b-bacb-be17a5e6548c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:32.398555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93875f23-1b87-442b-bacb-be17a5e6548c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:32.399034 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93875f23-1b87-442b-bacb-be17a5e6548c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:32.399465 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93875f23-1b87-442b-bacb-be17a5e6548c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:32.400155 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93875f23-1b87-442b-bacb-be17a5e6548c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:32.400632 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93875f23-1b87-442b-bacb-be17a5e6548c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:32.401055 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93875f23-1b87-442b-bacb-be17a5e6548c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:32.535241 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-93875f23-1b87-442b-bacb-be17a5e6548c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:32.543223 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-93875f23-1b87-442b-bacb-be17a5e6548c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1549 microversion: 2.1 time: 0.155376 Aug 19 15:28:32.543810 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 312/612] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:32 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:32.563886 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d90b6475-2cd9-485b-90ff-ff95bb865087 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:32.568590 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d90b6475-2cd9-485b-90ff-ff95bb865087 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:32.569373 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d90b6475-2cd9-485b-90ff-ff95bb865087 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Searching by: {'deleted': False, 'project_id': '3c3e603ab69848a2b9688f1e536017f3'} {{(pid=120637) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 19 15:28:32.576877 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d90b6475-2cd9-485b-90ff-ff95bb865087 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:32.577362 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d90b6475-2cd9-485b-90ff-ff95bb865087 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:32.577795 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d90b6475-2cd9-485b-90ff-ff95bb865087 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:32.578531 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d90b6475-2cd9-485b-90ff-ff95bb865087 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:32.578976 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d90b6475-2cd9-485b-90ff-ff95bb865087 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:32.579393 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d90b6475-2cd9-485b-90ff-ff95bb865087 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:32.684357 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.multi_cell_list [None req-d90b6475-2cd9-485b-90ff-ff95bb865087 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 19 15:28:32.791619 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d90b6475-2cd9-485b-90ff-ff95bb865087 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.232227 Aug 19 15:28:32.792218 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 301/613] 10.222.0.75 () {58 vars in 1125 bytes} [Fri Aug 19 15:28:32 2022] GET /compute/v2.1/servers => generated 342 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:32.804368 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9ad38b27-bd6d-467c-b239-0016bdabedfe tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:32.804999 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9ad38b27-bd6d-467c-b239-0016bdabedfe tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:32.812285 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ad38b27-bd6d-467c-b239-0016bdabedfe tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:32.812863 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ad38b27-bd6d-467c-b239-0016bdabedfe tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:32.813301 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ad38b27-bd6d-467c-b239-0016bdabedfe tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:32.814073 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ad38b27-bd6d-467c-b239-0016bdabedfe tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:32.814476 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ad38b27-bd6d-467c-b239-0016bdabedfe tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:32.814901 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ad38b27-bd6d-467c-b239-0016bdabedfe tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:32.853864 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e360874b-093e-448b-9588-dd3069a01ed2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:32.856222 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e360874b-093e-448b-9588-dd3069a01ed2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:32.864176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e360874b-093e-448b-9588-dd3069a01ed2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:32.864702 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e360874b-093e-448b-9588-dd3069a01ed2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:32.865132 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e360874b-093e-448b-9588-dd3069a01ed2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:32.865827 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e360874b-093e-448b-9588-dd3069a01ed2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:32.866269 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e360874b-093e-448b-9588-dd3069a01ed2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:32.866685 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e360874b-093e-448b-9588-dd3069a01ed2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:32.900246 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e360874b-093e-448b-9588-dd3069a01ed2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050372 Aug 19 15:28:32.900881 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 302/614] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:28:32 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:28:32.952510 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9ad38b27-bd6d-467c-b239-0016bdabedfe tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:32.960710 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9ad38b27-bd6d-467c-b239-0016bdabedfe tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1549 microversion: 2.1 time: 0.160039 Aug 19 15:28:32.961304 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 313/615] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:32 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:33.541014 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c14d69dd-a3d2-4635-abf1-7b3435805f67 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ee38767-9f57-4a49-91dd-536f890755e9"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:33.543459 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c14d69dd-a3d2-4635-abf1-7b3435805f67 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:33.551060 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c14d69dd-a3d2-4635-abf1-7b3435805f67 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:33.551570 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c14d69dd-a3d2-4635-abf1-7b3435805f67 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:33.552009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c14d69dd-a3d2-4635-abf1-7b3435805f67 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:33.552983 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c14d69dd-a3d2-4635-abf1-7b3435805f67 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:33.553613 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c14d69dd-a3d2-4635-abf1-7b3435805f67 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:33.554237 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c14d69dd-a3d2-4635-abf1-7b3435805f67 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:33.662609 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-c14d69dd-a3d2-4635-abf1-7b3435805f67 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] HTTP exception thrown: Invalid volume: volume 2ee38767-9f57-4a49-91dd-536f890755e9 is already attached to instances: 99291255-ef9c-4d2a-a163-35693eb609e8 Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c14d69dd-a3d2-4635-abf1-7b3435805f67 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Request method failure captured: Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: POST /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-volume_attachments HTTP/1.1 Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 74 Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6rjGIu42xaUfT_v0ZhOXSnvehT4QlYhL17z5n_oMEy5IgikNA5uN1BBFVSKHMDsc2O7a9I4Q5QwyQwXQspk3bwkVpeM9P9CWc98yKTuU8FguCcSJbu5xVwv6VOQ4CGubFMZO9oKGHBL5Wx4SbWH4Vr7DIv1aG8W2KhuYrqRW6sHXqA Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:28:33.664323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:28:33.666146 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf14c554d854af5ba8cd910c82d42e0", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:28:33.666146 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:28:33.666146 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:28:33.666146 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:28:33.666146 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:28:33.666146 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:28:33.666146 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:28:33.666146 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: 4aaa94a183fb49b79e6383ea783ab76d Aug 19 15:28:33.666146 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:28:33.666146 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Aug 19 15:28:33.666146 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {"volumeAttachment": {"volumeId": "2ee38767-9f57-4a49-91dd-536f890755e9"}} Aug 19 15:28:33.666146 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Invalid volume: volume 2ee38767-9f57-4a49-91dd-536f890755e9 is already attached to instances: 99291255-ef9c-4d2a-a163-35693eb609e8 Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'server_id': '99291255-ef9c-4d2a-a163-35693eb609e8', 'body': {'volumeAttachment': {'volumeId': '2ee38767-9f57-4a49-91dd-536f890755e9'}}} Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5119, in attach_volume Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4959, in _check_volume_already_attached Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2ee38767-9f57-4a49-91dd-536f890755e9 is already attached to instances: 99291255-ef9c-4d2a-a163-35693eb609e8 Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:28:33.666975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2ee38767-9f57-4a49-91dd-536f890755e9 is already attached to instances: 99291255-ef9c-4d2a-a163-35693eb609e8 Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:28:33.668128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:28:33.669361 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:28:33.669361 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:28:33.669361 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:28:33.669361 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2ee38767-9f57-4a49-91dd-536f890755e9 is already attached to instances: 99291255-ef9c-4d2a-a163-35693eb609e8 Aug 19 15:28:33.669361 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:28:33.669361 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c14d69dd-a3d2-4635-abf1-7b3435805f67 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Returning 400 to user: Invalid volume: volume 2ee38767-9f57-4a49-91dd-536f890755e9 is already attached to instances: 99291255-ef9c-4d2a-a163-35693eb609e8 {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:28:33.669361 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c14d69dd-a3d2-4635-abf1-7b3435805f67 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "POST /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.129171 Aug 19 15:28:33.669361 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 303/616] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Aug 19 15:28:33 2022] POST /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-volume_attachments => generated 174 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 19 15:28:33.737708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eb651613-b9af-4045-8d3c-35efd6f4807f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:33.738304 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eb651613-b9af-4045-8d3c-35efd6f4807f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:33.745433 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb651613-b9af-4045-8d3c-35efd6f4807f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:33.745923 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb651613-b9af-4045-8d3c-35efd6f4807f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:33.746528 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb651613-b9af-4045-8d3c-35efd6f4807f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:33.747237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb651613-b9af-4045-8d3c-35efd6f4807f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:33.747692 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb651613-b9af-4045-8d3c-35efd6f4807f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:33.748822 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb651613-b9af-4045-8d3c-35efd6f4807f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:33.832406 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-eb651613-b9af-4045-8d3c-35efd6f4807f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lazy-loading 'services' on Instance uuid 99291255-ef9c-4d2a-a163-35693eb609e8 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:28:33.908970 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eb651613-b9af-4045-8d3c-35efd6f4807f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "DELETE /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-volume_attachments/2ee38767-9f57-4a49-91dd-536f890755e9" status: 202 len: 0 microversion: 2.1 time: 0.175332 Aug 19 15:28:33.909570 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 314/617] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Aug 19 15:28:33 2022] DELETE /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-volume_attachments/2ee38767-9f57-4a49-91dd-536f890755e9 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:28:33.913435 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9a9dbdcd-9ace-4e62-b018-c8f1dafc07d9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:33.915529 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9a9dbdcd-9ace-4e62-b018-c8f1dafc07d9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:33.918087 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-576a10f0-de6f-48ba-8ce2-584a16268e02 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:33.921016 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-576a10f0-de6f-48ba-8ce2-584a16268e02 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:33.922506 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a9dbdcd-9ace-4e62-b018-c8f1dafc07d9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:33.923300 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a9dbdcd-9ace-4e62-b018-c8f1dafc07d9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:33.923677 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a9dbdcd-9ace-4e62-b018-c8f1dafc07d9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:33.924365 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a9dbdcd-9ace-4e62-b018-c8f1dafc07d9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:33.925021 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a9dbdcd-9ace-4e62-b018-c8f1dafc07d9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:33.925442 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a9dbdcd-9ace-4e62-b018-c8f1dafc07d9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:33.927762 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-576a10f0-de6f-48ba-8ce2-584a16268e02 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:33.928256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-576a10f0-de6f-48ba-8ce2-584a16268e02 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:33.928722 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-576a10f0-de6f-48ba-8ce2-584a16268e02 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:33.929425 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-576a10f0-de6f-48ba-8ce2-584a16268e02 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:33.929886 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-576a10f0-de6f-48ba-8ce2-584a16268e02 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:33.930297 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-576a10f0-de6f-48ba-8ce2-584a16268e02 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:33.961920 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-576a10f0-de6f-48ba-8ce2-584a16268e02 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047652 Aug 19 15:28:33.967488 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9a9dbdcd-9ace-4e62-b018-c8f1dafc07d9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053393 Aug 19 15:28:33.968196 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 315/618] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:28:33 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:28:33.968371 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 304/619] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:28:33 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 19 15:28:34.041561 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-53890f34-ec8e-4619-9573-7fd315c3d194 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:34.042056 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-53890f34-ec8e-4619-9573-7fd315c3d194 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:34.049279 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53890f34-ec8e-4619-9573-7fd315c3d194 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:34.049759 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53890f34-ec8e-4619-9573-7fd315c3d194 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:34.050190 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53890f34-ec8e-4619-9573-7fd315c3d194 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:34.050880 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53890f34-ec8e-4619-9573-7fd315c3d194 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:34.051326 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53890f34-ec8e-4619-9573-7fd315c3d194 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:34.051744 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53890f34-ec8e-4619-9573-7fd315c3d194 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:34.077370 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-53890f34-ec8e-4619-9573-7fd315c3d194 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:28:34.155773 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-53890f34-ec8e-4619-9573-7fd315c3d194 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 204 len: 0 microversion: 2.1 time: 0.117704 Aug 19 15:28:34.156268 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 316/620] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:28:34 2022] DELETE /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:28:34.164900 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a7afdd5a-7059-4afe-b0ab-3cd6b4ca378e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:34.165547 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a7afdd5a-7059-4afe-b0ab-3cd6b4ca378e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:34.174109 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7afdd5a-7059-4afe-b0ab-3cd6b4ca378e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:34.174590 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7afdd5a-7059-4afe-b0ab-3cd6b4ca378e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:34.175019 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7afdd5a-7059-4afe-b0ab-3cd6b4ca378e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:34.175707 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7afdd5a-7059-4afe-b0ab-3cd6b4ca378e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:34.176157 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7afdd5a-7059-4afe-b0ab-3cd6b4ca378e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:34.176961 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7afdd5a-7059-4afe-b0ab-3cd6b4ca378e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:34.320780 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a7afdd5a-7059-4afe-b0ab-3cd6b4ca378e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:34.328673 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a7afdd5a-7059-4afe-b0ab-3cd6b4ca378e tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1689 microversion: 2.1 time: 0.168081 Aug 19 15:28:34.329418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 305/621] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:34 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:34.597614 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-42db5464-c364-445d-9665-4e8ba6d72b35 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f3e8d25-2080-4042-a2a9-d57384f680c6"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:34.599959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-42db5464-c364-445d-9665-4e8ba6d72b35 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:34.605811 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42db5464-c364-445d-9665-4e8ba6d72b35 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:34.606278 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42db5464-c364-445d-9665-4e8ba6d72b35 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:34.606703 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42db5464-c364-445d-9665-4e8ba6d72b35 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:34.608062 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42db5464-c364-445d-9665-4e8ba6d72b35 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:34.608533 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42db5464-c364-445d-9665-4e8ba6d72b35 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:34.608949 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-42db5464-c364-445d-9665-4e8ba6d72b35 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:34.975372 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-38362bd9-f364-4a6a-82f5-daea25ba3d93 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:34.977605 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-38362bd9-f364-4a6a-82f5-daea25ba3d93 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:34.984237 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38362bd9-f364-4a6a-82f5-daea25ba3d93 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:34.984818 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38362bd9-f364-4a6a-82f5-daea25ba3d93 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:34.985251 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38362bd9-f364-4a6a-82f5-daea25ba3d93 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:34.985931 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38362bd9-f364-4a6a-82f5-daea25ba3d93 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:34.986379 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38362bd9-f364-4a6a-82f5-daea25ba3d93 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:34.986798 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38362bd9-f364-4a6a-82f5-daea25ba3d93 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:35.016707 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-38362bd9-f364-4a6a-82f5-daea25ba3d93 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045329 Aug 19 15:28:35.017309 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 306/622] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:28:34 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:28:35.349610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b820d345-7458-42dc-8543-dd4c043921c2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:35.350314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b820d345-7458-42dc-8543-dd4c043921c2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:35.356197 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b820d345-7458-42dc-8543-dd4c043921c2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:35.356701 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b820d345-7458-42dc-8543-dd4c043921c2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:35.357131 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b820d345-7458-42dc-8543-dd4c043921c2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:35.358005 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b820d345-7458-42dc-8543-dd4c043921c2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:35.358450 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b820d345-7458-42dc-8543-dd4c043921c2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:35.358867 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b820d345-7458-42dc-8543-dd4c043921c2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:35.485108 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b820d345-7458-42dc-8543-dd4c043921c2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:35.493008 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b820d345-7458-42dc-8543-dd4c043921c2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1689 microversion: 2.1 time: 0.147259 Aug 19 15:28:35.493570 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 307/623] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:35 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:28:36.029565 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d041127b-073a-461a-aff0-554bc9154052 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:36.031700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d041127b-073a-461a-aff0-554bc9154052 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:36.038447 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d041127b-073a-461a-aff0-554bc9154052 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:36.038929 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d041127b-073a-461a-aff0-554bc9154052 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:36.039361 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d041127b-073a-461a-aff0-554bc9154052 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:36.040042 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d041127b-073a-461a-aff0-554bc9154052 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:36.040530 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d041127b-073a-461a-aff0-554bc9154052 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:36.040951 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d041127b-073a-461a-aff0-554bc9154052 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:36.073366 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d041127b-073a-461a-aff0-554bc9154052 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048085 Aug 19 15:28:36.073918 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 308/624] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:28:36 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:28:36.514377 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7f5f6887-8f1a-4560-8ff9-348aea14505d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:36.514973 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7f5f6887-8f1a-4560-8ff9-348aea14505d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:36.520845 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f5f6887-8f1a-4560-8ff9-348aea14505d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:36.521317 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f5f6887-8f1a-4560-8ff9-348aea14505d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:36.521745 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f5f6887-8f1a-4560-8ff9-348aea14505d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:36.522411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f5f6887-8f1a-4560-8ff9-348aea14505d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:36.522848 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f5f6887-8f1a-4560-8ff9-348aea14505d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:36.523258 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f5f6887-8f1a-4560-8ff9-348aea14505d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:36.652909 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7f5f6887-8f1a-4560-8ff9-348aea14505d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:36.660683 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7f5f6887-8f1a-4560-8ff9-348aea14505d tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1689 microversion: 2.1 time: 0.150487 Aug 19 15:28:36.661249 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 309/625] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:36 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:28:37.086245 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8165289b-9e4c-4990-b768-b403a43283ec tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:37.088364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8165289b-9e4c-4990-b768-b403a43283ec tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:37.095334 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8165289b-9e4c-4990-b768-b403a43283ec tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:37.095815 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8165289b-9e4c-4990-b768-b403a43283ec tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:37.096248 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8165289b-9e4c-4990-b768-b403a43283ec tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:37.096971 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8165289b-9e4c-4990-b768-b403a43283ec tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:37.097422 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8165289b-9e4c-4990-b768-b403a43283ec tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:37.097842 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8165289b-9e4c-4990-b768-b403a43283ec tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:37.129323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8165289b-9e4c-4990-b768-b403a43283ec tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046945 Aug 19 15:28:37.129886 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 310/626] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:28:37 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:28:37.681607 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-42db5464-c364-445d-9665-4e8ba6d72b35 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "POST /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.088037 Aug 19 15:28:37.682524 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 317/627] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Aug 19 15:28:34 2022] POST /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5/os-volume_attachments => generated 194 bytes in 3090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:37.683331 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e9cac9ad-3d1b-4bd8-ad53-f7fac6a168e5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:37.683972 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e9cac9ad-3d1b-4bd8-ad53-f7fac6a168e5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:37.689981 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9cac9ad-3d1b-4bd8-ad53-f7fac6a168e5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:37.690465 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9cac9ad-3d1b-4bd8-ad53-f7fac6a168e5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:37.690896 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9cac9ad-3d1b-4bd8-ad53-f7fac6a168e5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:37.691585 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9cac9ad-3d1b-4bd8-ad53-f7fac6a168e5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:37.692038 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9cac9ad-3d1b-4bd8-ad53-f7fac6a168e5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:37.692492 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9cac9ad-3d1b-4bd8-ad53-f7fac6a168e5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:37.835219 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e9cac9ad-3d1b-4bd8-ad53-f7fac6a168e5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:37.843284 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e9cac9ad-3d1b-4bd8-ad53-f7fac6a168e5 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1689 microversion: 2.1 time: 0.164906 Aug 19 15:28:37.843848 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 311/628] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:37 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:38.143150 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e84be651-88fc-45ba-b86c-0809b60a7a99 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:38.145423 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e84be651-88fc-45ba-b86c-0809b60a7a99 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:38.151521 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e84be651-88fc-45ba-b86c-0809b60a7a99 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:38.152095 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e84be651-88fc-45ba-b86c-0809b60a7a99 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:38.152560 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e84be651-88fc-45ba-b86c-0809b60a7a99 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:38.153250 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e84be651-88fc-45ba-b86c-0809b60a7a99 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:38.153704 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e84be651-88fc-45ba-b86c-0809b60a7a99 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:38.154319 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e84be651-88fc-45ba-b86c-0809b60a7a99 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:38.156812 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:38.190566 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e84be651-88fc-45ba-b86c-0809b60a7a99 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052361 Aug 19 15:28:38.191213 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 318/629] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:28:38 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 15:28:38.256147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8fd53744-f64a-427b-a40b-dda31db4ed31 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:38.256679 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8fd53744-f64a-427b-a40b-dda31db4ed31 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:38.263602 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fd53744-f64a-427b-a40b-dda31db4ed31 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:38.264076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fd53744-f64a-427b-a40b-dda31db4ed31 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:38.264530 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fd53744-f64a-427b-a40b-dda31db4ed31 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:38.265959 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fd53744-f64a-427b-a40b-dda31db4ed31 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:38.266763 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fd53744-f64a-427b-a40b-dda31db4ed31 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:38.267186 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fd53744-f64a-427b-a40b-dda31db4ed31 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:38.294626 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8fd53744-f64a-427b-a40b-dda31db4ed31 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:28:38.340731 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:38.374055 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8fd53744-f64a-427b-a40b-dda31db4ed31 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "DELETE /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 204 len: 0 microversion: 2.1 time: 0.121439 Aug 19 15:28:38.375083 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 312/630] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:28:38 2022] DELETE /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:28:38.383244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8f72b8e8-a258-4dfc-ae21-d4745e1b8592 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:38.383858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8f72b8e8-a258-4dfc-ae21-d4745e1b8592 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:38.390624 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f72b8e8-a258-4dfc-ae21-d4745e1b8592 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:38.391116 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f72b8e8-a258-4dfc-ae21-d4745e1b8592 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:38.391555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f72b8e8-a258-4dfc-ae21-d4745e1b8592 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:38.392254 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f72b8e8-a258-4dfc-ae21-d4745e1b8592 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:38.392745 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f72b8e8-a258-4dfc-ae21-d4745e1b8592 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:38.393221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f72b8e8-a258-4dfc-ae21-d4745e1b8592 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:38.534954 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8f72b8e8-a258-4dfc-ae21-d4745e1b8592 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:38.542858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8f72b8e8-a258-4dfc-ae21-d4745e1b8592 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1682 microversion: 2.1 time: 0.163438 Aug 19 15:28:38.543428 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 319/631] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:38 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:38.761495 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-1b3e1c73-0380-475a-aa1a-74e0e7b79686 req-5d538a19-dd60-4923-b5c0-e60a40452541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73df7a2-f347-4f80-8853-f5ea25b0cbc7", "name": "network-vif-deleted", "tag": "ca54f86e-c00b-4076-ac42-4e78405cb1a7"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:38.776003 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1b3e1c73-0380-475a-aa1a-74e0e7b79686 req-5d538a19-dd60-4923-b5c0-e60a40452541 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:38.776723 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1b3e1c73-0380-475a-aa1a-74e0e7b79686 req-5d538a19-dd60-4923-b5c0-e60a40452541 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:38.777341 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1b3e1c73-0380-475a-aa1a-74e0e7b79686 req-5d538a19-dd60-4923-b5c0-e60a40452541 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:38.795595 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-1b3e1c73-0380-475a-aa1a-74e0e7b79686 req-5d538a19-dd60-4923-b5c0-e60a40452541 service nova] Creating event network-vif-deleted:ca54f86e-c00b-4076-ac42-4e78405cb1a7 for instance c73df7a2-f347-4f80-8853-f5ea25b0cbc7 on hv-cinder-83538 Aug 19 15:28:38.802427 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-1b3e1c73-0380-475a-aa1a-74e0e7b79686 req-5d538a19-dd60-4923-b5c0-e60a40452541 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099105 Aug 19 15:28:38.803709 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 313/632] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:38.866960 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8bb156dc-0a32-4ca1-8585-e0724c0753b6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:38.868272 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8bb156dc-0a32-4ca1-8585-e0724c0753b6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:38.875879 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bb156dc-0a32-4ca1-8585-e0724c0753b6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:38.876743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bb156dc-0a32-4ca1-8585-e0724c0753b6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:38.877250 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bb156dc-0a32-4ca1-8585-e0724c0753b6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:38.878197 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bb156dc-0a32-4ca1-8585-e0724c0753b6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:38.878657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bb156dc-0a32-4ca1-8585-e0724c0753b6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:38.879322 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bb156dc-0a32-4ca1-8585-e0724c0753b6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:38.952185 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8bb156dc-0a32-4ca1-8585-e0724c0753b6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:38.959945 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8bb156dc-0a32-4ca1-8585-e0724c0753b6 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1621 microversion: 2.1 time: 0.096861 Aug 19 15:28:38.960527 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 320/633] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:38 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1621 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:39.565837 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c139b7c8-0864-45f4-91a3-d4b978939759 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:39.566534 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c139b7c8-0864-45f4-91a3-d4b978939759 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:39.572739 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c139b7c8-0864-45f4-91a3-d4b978939759 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:39.573217 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c139b7c8-0864-45f4-91a3-d4b978939759 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:39.573648 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c139b7c8-0864-45f4-91a3-d4b978939759 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:39.574330 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c139b7c8-0864-45f4-91a3-d4b978939759 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:39.574777 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c139b7c8-0864-45f4-91a3-d4b978939759 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:39.575399 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c139b7c8-0864-45f4-91a3-d4b978939759 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:39.707950 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c139b7c8-0864-45f4-91a3-d4b978939759 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:39.715885 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c139b7c8-0864-45f4-91a3-d4b978939759 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1682 microversion: 2.1 time: 0.154711 Aug 19 15:28:39.716486 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 314/634] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:39 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:39.980732 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-25672ce2-22c8-412d-b760-ebfcb70113c9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:39.981336 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-25672ce2-22c8-412d-b760-ebfcb70113c9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:39.987808 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25672ce2-22c8-412d-b760-ebfcb70113c9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:39.988291 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25672ce2-22c8-412d-b760-ebfcb70113c9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:39.988758 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25672ce2-22c8-412d-b760-ebfcb70113c9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:39.989448 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25672ce2-22c8-412d-b760-ebfcb70113c9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:39.989904 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25672ce2-22c8-412d-b760-ebfcb70113c9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:39.990328 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25672ce2-22c8-412d-b760-ebfcb70113c9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:40.022424 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25672ce2-22c8-412d-b760-ebfcb70113c9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:40.022899 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25672ce2-22c8-412d-b760-ebfcb70113c9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:40.023328 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25672ce2-22c8-412d-b760-ebfcb70113c9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:40.023764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-25672ce2-22c8-412d-b760-ebfcb70113c9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lazy-loading 'fault' on Instance uuid c73df7a2-f347-4f80-8853-f5ea25b0cbc7 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:28:40.065369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-25672ce2-22c8-412d-b760-ebfcb70113c9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:40.073506 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-25672ce2-22c8-412d-b760-ebfcb70113c9 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 200 len: 1335 microversion: 2.1 time: 0.096818 Aug 19 15:28:40.074068 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 321/635] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:39 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 1335 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:40.738629 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-167e833e-aa16-4720-8a88-e539278181d2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:40.739239 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-167e833e-aa16-4720-8a88-e539278181d2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:40.745990 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-167e833e-aa16-4720-8a88-e539278181d2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:40.746472 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-167e833e-aa16-4720-8a88-e539278181d2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:40.746901 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-167e833e-aa16-4720-8a88-e539278181d2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:40.747593 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-167e833e-aa16-4720-8a88-e539278181d2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:40.748036 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-167e833e-aa16-4720-8a88-e539278181d2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:40.748481 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-167e833e-aa16-4720-8a88-e539278181d2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:40.891690 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-167e833e-aa16-4720-8a88-e539278181d2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:40.900934 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-167e833e-aa16-4720-8a88-e539278181d2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1682 microversion: 2.1 time: 0.166224 Aug 19 15:28:40.901706 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 315/636] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:40 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:41.094747 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7cc77340-0ae6-45a8-a770-8ebdf3e8bba3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:41.095366 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7cc77340-0ae6-45a8-a770-8ebdf3e8bba3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: c73df7a2-f347-4f80-8853-f5ea25b0cbc7] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:41.097657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:41.102750 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cc77340-0ae6-45a8-a770-8ebdf3e8bba3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:41.103227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cc77340-0ae6-45a8-a770-8ebdf3e8bba3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:41.103712 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cc77340-0ae6-45a8-a770-8ebdf3e8bba3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:41.104342 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cc77340-0ae6-45a8-a770-8ebdf3e8bba3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:41.104900 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cc77340-0ae6-45a8-a770-8ebdf3e8bba3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:41.105322 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7cc77340-0ae6-45a8-a770-8ebdf3e8bba3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:41.123627 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-7cc77340-0ae6-45a8-a770-8ebdf3e8bba3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] HTTP exception thrown: Instance c73df7a2-f347-4f80-8853-f5ea25b0cbc7 could not be found. Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7cc77340-0ae6-45a8-a770-8ebdf3e8bba3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Request method failure captured: Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 HTTP/1.1 Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6rldajWYu2a-wna4OYo7oT4PcVjfwOm5e53qr2wAzq1ke5P0YP7OvzwS0BQ7ZlWVHc9-8RfuQH42A1aK3RMPmXHvxct5oXkEXNEyZU87L546gCy6y0evh0UzcyVgOF-eIz1PDrc-6_6aRbz90Zhzpipvod_2wqGIrmzTxACvIsXGwY Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: dcca6c7d30114cd0936eb30381efad7d Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-592584515 Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:28:41.126281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:28:41.127875 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_dcca6c7d30114cd0936eb30381efad7d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcca6c7d30114cd0936eb30381efad7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcca6c7d30114cd0936eb30381efad7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/dcca6c7d30114cd0936eb30381efad7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:28:41.127875 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-592584515 Aug 19 15:28:41.127875 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: dcca6c7d30114cd0936eb30381efad7d Aug 19 15:28:41.127875 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-592584515 Aug 19 15:28:41.127875 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-ServerRescueNegativeTestJSON-592584515-project Aug 19 15:28:41.127875 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:28:41.127875 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:28:41.127875 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 218f3dd17e6549fc8796eb30e4b48e24 Aug 19 15:28:41.127875 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-592584515-project Aug 19 15:28:41.127875 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:28:41.127875 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance c73df7a2-f347-4f80-8853-f5ea25b0cbc7 could not be found. Aug 19 15:28:41.127875 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': 'c73df7a2-f347-4f80-8853-f5ea25b0cbc7'} Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c73df7a2-f347-4f80-8853-f5ea25b0cbc7 could not be found. Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:28:41.128764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:28:41.130270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:28:41.130270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:28:41.130270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:28:41.130270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:28:41.130270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:28:41.130270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:28:41.130270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:28:41.130270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c73df7a2-f347-4f80-8853-f5ea25b0cbc7 could not be found. Aug 19 15:28:41.130270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:41.130270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:28:41.130270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:41.130270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:28:41.130270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:28:41.130270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:28:41.130270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:28:41.130270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:28:41.130270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c73df7a2-f347-4f80-8853-f5ea25b0cbc7 could not be found. Aug 19 15:28:41.130270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:41.131612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7cc77340-0ae6-45a8-a770-8ebdf3e8bba3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Returning 404 to user: Instance c73df7a2-f347-4f80-8853-f5ea25b0cbc7 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:28:41.131612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7cc77340-0ae6-45a8-a770-8ebdf3e8bba3 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7" status: 404 len: 111 microversion: 2.1 time: 0.037109 Aug 19 15:28:41.131612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 322/637] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:41 2022] GET /compute/v2.1/servers/c73df7a2-f347-4f80-8853-f5ea25b0cbc7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:28:41.137233 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-626ca52b-710b-4148-8224-cfd956067a73 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '.version_select at 0x7fb5331dd670>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:41.163584 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-626ca52b-710b-4148-8224-cfd956067a73 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1988567655" status: 202 len: 0 microversion: 2.1 time: 0.030253 Aug 19 15:28:41.164474 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 316/638] 10.222.0.75 () {58 vars in 1221 bytes} [Fri Aug 19 15:28:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1988567655 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:28:41.537438 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-97946afa-cf98-4ca3-acf7-8ab153c2007c req-4f53afb5-d5e2-4903-9351-f491a5e4395b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99291255-ef9c-4d2a-a163-35693eb609e8", "name": "network-vif-deleted", "tag": "b67e36ec-dcec-4889-867b-e63b9b85adce"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:41.554746 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-97946afa-cf98-4ca3-acf7-8ab153c2007c req-4f53afb5-d5e2-4903-9351-f491a5e4395b service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:41.555215 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-97946afa-cf98-4ca3-acf7-8ab153c2007c req-4f53afb5-d5e2-4903-9351-f491a5e4395b service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:41.555700 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-97946afa-cf98-4ca3-acf7-8ab153c2007c req-4f53afb5-d5e2-4903-9351-f491a5e4395b service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:41.590638 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-97946afa-cf98-4ca3-acf7-8ab153c2007c req-4f53afb5-d5e2-4903-9351-f491a5e4395b service nova] Creating event network-vif-deleted:b67e36ec-dcec-4889-867b-e63b9b85adce for instance 99291255-ef9c-4d2a-a163-35693eb609e8 on hv-cinder-83538 Aug 19 15:28:41.598334 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-97946afa-cf98-4ca3-acf7-8ab153c2007c req-4f53afb5-d5e2-4903-9351-f491a5e4395b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064437 Aug 19 15:28:41.599649 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 323/639] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:41.927905 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5555e38b-05b0-4611-a5dd-e8494551e59c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:41.928595 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5555e38b-05b0-4611-a5dd-e8494551e59c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:41.935582 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5555e38b-05b0-4611-a5dd-e8494551e59c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:41.936069 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5555e38b-05b0-4611-a5dd-e8494551e59c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:41.937686 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5555e38b-05b0-4611-a5dd-e8494551e59c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:41.938646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5555e38b-05b0-4611-a5dd-e8494551e59c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:41.939105 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5555e38b-05b0-4611-a5dd-e8494551e59c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:41.939619 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5555e38b-05b0-4611-a5dd-e8494551e59c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:41.977197 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5555e38b-05b0-4611-a5dd-e8494551e59c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:41.977679 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5555e38b-05b0-4611-a5dd-e8494551e59c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:41.978155 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5555e38b-05b0-4611-a5dd-e8494551e59c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:41.978673 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-5555e38b-05b0-4611-a5dd-e8494551e59c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lazy-loading 'fault' on Instance uuid 99291255-ef9c-4d2a-a163-35693eb609e8 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:28:42.032113 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5555e38b-05b0-4611-a5dd-e8494551e59c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:42.043358 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5555e38b-05b0-4611-a5dd-e8494551e59c tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 200 len: 1331 microversion: 2.1 time: 0.119979 Aug 19 15:28:42.045139 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 317/640] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:41 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 1331 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:43.066531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a26cab1a-7e6d-4398-8dae-3f21d04e37e9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:43.067325 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a26cab1a-7e6d-4398-8dae-3f21d04e37e9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:43.073725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a26cab1a-7e6d-4398-8dae-3f21d04e37e9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:43.074205 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a26cab1a-7e6d-4398-8dae-3f21d04e37e9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:43.074632 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a26cab1a-7e6d-4398-8dae-3f21d04e37e9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:43.075309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a26cab1a-7e6d-4398-8dae-3f21d04e37e9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:43.075754 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a26cab1a-7e6d-4398-8dae-3f21d04e37e9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:43.076166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a26cab1a-7e6d-4398-8dae-3f21d04e37e9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:43.089777 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-a26cab1a-7e6d-4398-8dae-3f21d04e37e9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] HTTP exception thrown: Instance 99291255-ef9c-4d2a-a163-35693eb609e8 could not be found. Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a26cab1a-7e6d-4398-8dae-3f21d04e37e9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Request method failure captured: Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 HTTP/1.1 Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6rjGIu42xaUfT_v0ZhOXSnvehT4QlYhL17z5n_oMEy5IgikNA5uN1BBFVSKHMDsc2O7a9I4Q5QwyQwXQspk3bwkVpeM9P9CWc98yKTuU8FguCcSJbu5xVwv6VOQ4CGubFMZO9oKGHBL5Wx4SbWH4Vr7DIv1aG8W2KhuYrqRW6sHXqA Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:28:43.091353 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:28:43.093531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf14c554d854af5ba8cd910c82d42e0", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:28:43.093531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:28:43.093531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:28:43.093531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:28:43.093531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:28:43.093531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:28:43.093531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:28:43.093531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 4aaa94a183fb49b79e6383ea783ab76d Aug 19 15:28:43.093531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:28:43.093531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:28:43.093531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance 99291255-ef9c-4d2a-a163-35693eb609e8 could not be found. Aug 19 15:28:43.093531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': '99291255-ef9c-4d2a-a163-35693eb609e8'} Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99291255-ef9c-4d2a-a163-35693eb609e8 could not be found. Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:28:43.094419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:28:43.095936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:28:43.095936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:28:43.095936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:28:43.095936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:28:43.095936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:28:43.095936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:28:43.095936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:28:43.095936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99291255-ef9c-4d2a-a163-35693eb609e8 could not be found. Aug 19 15:28:43.095936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:43.095936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:28:43.095936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:43.095936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:28:43.095936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:28:43.095936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:28:43.095936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:28:43.095936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:28:43.095936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99291255-ef9c-4d2a-a163-35693eb609e8 could not be found. Aug 19 15:28:43.095936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:43.097506 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a26cab1a-7e6d-4398-8dae-3f21d04e37e9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Returning 404 to user: Instance 99291255-ef9c-4d2a-a163-35693eb609e8 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:28:43.097506 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a26cab1a-7e6d-4398-8dae-3f21d04e37e9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 404 len: 111 microversion: 2.1 time: 0.030442 Aug 19 15:28:43.097506 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 324/641] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:43 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:28:43.102040 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-47954fd8-15a1-4119-96f3-2bc2b16d76cf tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '.version_select at 0x7fb5331dd5e0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:43.106632 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:43.122155 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-47954fd8-15a1-4119-96f3-2bc2b16d76cf tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-465619978" status: 202 len: 0 microversion: 2.1 time: 0.023805 Aug 19 15:28:43.122731 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 318/642] 10.222.0.75 () {58 vars in 1218 bytes} [Fri Aug 19 15:28:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-465619978 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:28:43.752329 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a9560469-90b0-4ea1-80fa-42e20554f846 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Action: 'create', calling method: .version_select at 0x7fb533428310>, body: {"keypair": {"name": "tempest-keypair-982286609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzhdL7Yc5kqI7vcYeHjdXlIp6l5ut/++WEXCEu+KZ5k3kFsRDeud5Bs720FYIb5GpyYdYDijU0WLE/bPrcPbTsmSKmmaicROS3L4OODbN9k2T/qCiPl4ot6Znss2f+nPg=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:43.768632 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-a9560469-90b0-4ea1-80fa-42e20554f846 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Getting quotas for project cbf14c554d854af5ba8cd910c82d42e0. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:28:43.772517 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-a9560469-90b0-4ea1-80fa-42e20554f846 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Getting quotas for user 4aaa94a183fb49b79e6383ea783ab76d and project cbf14c554d854af5ba8cd910c82d42e0. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:28:43.793772 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a9560469-90b0-4ea1-80fa-42e20554f846 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045440 Aug 19 15:28:43.794359 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 325/643] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Aug 19 15:28:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:44.266185 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e3f08e3d-dd04-42a0-910a-376293cb2280 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:44.266711 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e3f08e3d-dd04-42a0-910a-376293cb2280 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:44.272590 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3f08e3d-dd04-42a0-910a-376293cb2280 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:44.273290 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3f08e3d-dd04-42a0-910a-376293cb2280 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:44.273721 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3f08e3d-dd04-42a0-910a-376293cb2280 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:44.274409 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3f08e3d-dd04-42a0-910a-376293cb2280 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:44.274877 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3f08e3d-dd04-42a0-910a-376293cb2280 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:44.275476 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3f08e3d-dd04-42a0-910a-376293cb2280 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:44.303279 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e3f08e3d-dd04-42a0-910a-376293cb2280 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:28:44.383822 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e3f08e3d-dd04-42a0-910a-376293cb2280 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "DELETE /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 204 len: 0 microversion: 2.1 time: 0.122467 Aug 19 15:28:44.384762 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 319/644] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:28:44 2022] DELETE /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 19 15:28:44.394907 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-472836d3-9322-40e1-a09a-50c1d21f8241 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:44.396247 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-472836d3-9322-40e1-a09a-50c1d21f8241 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:44.402689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-472836d3-9322-40e1-a09a-50c1d21f8241 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:44.403182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-472836d3-9322-40e1-a09a-50c1d21f8241 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:44.403613 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-472836d3-9322-40e1-a09a-50c1d21f8241 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:44.404565 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-472836d3-9322-40e1-a09a-50c1d21f8241 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:44.405621 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-472836d3-9322-40e1-a09a-50c1d21f8241 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:44.405997 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-472836d3-9322-40e1-a09a-50c1d21f8241 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:44.540104 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-472836d3-9322-40e1-a09a-50c1d21f8241 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:44.548858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-472836d3-9322-40e1-a09a-50c1d21f8241 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1507 microversion: 2.1 time: 0.159741 Aug 19 15:28:44.549421 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 326/645] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:44 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:28:45.074772 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-783e555b-3843-42c7-9862-d63765c92fda tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2128791807", "imageRef": "27174b76-85e7-4123-a2bc-847959ca59f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a74f9df-bea0-4bc2-8022-d4f3c9598ba3"}], "security_groups": [{"name": "tempest-securitygroup--1506024888"}], "key_name": "tempest-keypair-982286609", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:45.187942 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-783e555b-3843-42c7-9862-d63765c92fda tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] validate_networks() for [('6a74f9df-bea0-4bc2-8022-d4f3c9598ba3', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:28:45.342346 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ed584e96-4cd2-44e9-9766-d094340b4d18 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:45.342953 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ed584e96-4cd2-44e9-9766-d094340b4d18 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:45.349580 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed584e96-4cd2-44e9-9766-d094340b4d18 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:45.350066 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed584e96-4cd2-44e9-9766-d094340b4d18 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:45.350497 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed584e96-4cd2-44e9-9766-d094340b4d18 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:45.351186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed584e96-4cd2-44e9-9766-d094340b4d18 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:45.351636 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed584e96-4cd2-44e9-9766-d094340b4d18 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:45.352055 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed584e96-4cd2-44e9-9766-d094340b4d18 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:45.539189 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ed584e96-4cd2-44e9-9766-d094340b4d18 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:45.549279 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ed584e96-4cd2-44e9-9766-d094340b4d18 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1595 microversion: 2.1 time: 0.210826 Aug 19 15:28:45.549882 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 327/646] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:45 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1595 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:28:45.573019 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4adaa3c0-216b-41bb-8062-27ae407285ad tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:45.573643 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4adaa3c0-216b-41bb-8062-27ae407285ad tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:45.582477 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4adaa3c0-216b-41bb-8062-27ae407285ad tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:45.583212 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4adaa3c0-216b-41bb-8062-27ae407285ad tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:45.583639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4adaa3c0-216b-41bb-8062-27ae407285ad tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:45.584333 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4adaa3c0-216b-41bb-8062-27ae407285ad tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:45.584818 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4adaa3c0-216b-41bb-8062-27ae407285ad tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:45.585226 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4adaa3c0-216b-41bb-8062-27ae407285ad tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:45.715801 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-783e555b-3843-42c7-9862-d63765c92fda tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:28:45.716556 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-783e555b-3843-42c7-9862-d63765c92fda tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:28:45.716706 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-783e555b-3843-42c7-9862-d63765c92fda tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:28:45.717312 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-783e555b-3843-42c7-9862-d63765c92fda tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:28:45.717947 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-783e555b-3843-42c7-9862-d63765c92fda tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:28:45.727604 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-783e555b-3843-42c7-9862-d63765c92fda tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:45.728198 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-783e555b-3843-42c7-9862-d63765c92fda tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:45.728770 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-783e555b-3843-42c7-9862-d63765c92fda tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:45.729552 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-783e555b-3843-42c7-9862-d63765c92fda tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:45.730215 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-783e555b-3843-42c7-9862-d63765c92fda tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:45.730708 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-783e555b-3843-42c7-9862-d63765c92fda tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:45.749505 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-783e555b-3843-42c7-9862-d63765c92fda tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Getting quotas for project cbf14c554d854af5ba8cd910c82d42e0. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:28:45.754896 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-783e555b-3843-42c7-9862-d63765c92fda tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Getting quotas for user 4aaa94a183fb49b79e6383ea783ab76d and project cbf14c554d854af5ba8cd910c82d42e0. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:28:45.756992 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4adaa3c0-216b-41bb-8062-27ae407285ad tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:45.764501 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:45.768152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-783e555b-3843-42c7-9862-d63765c92fda tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:28:45.770468 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4adaa3c0-216b-41bb-8062-27ae407285ad tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1507 microversion: 2.1 time: 0.204155 Aug 19 15:28:45.770908 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-783e555b-3843-42c7-9862-d63765c92fda tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27174b76-85e7-4123-a2bc-847959ca59f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:28:45.771872 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 328/647] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:45 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1507 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:45.822921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-783e555b-3843-42c7-9862-d63765c92fda tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.752731 Aug 19 15:28:45.823731 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 320/648] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:28:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 15:28:45.834742 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d5ea88d8-14cd-4b34-9165-4c42a030ba20 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:45.836039 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d5ea88d8-14cd-4b34-9165-4c42a030ba20 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:45.912910 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d5ea88d8-14cd-4b34-9165-4c42a030ba20 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:45.921453 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d5ea88d8-14cd-4b34-9165-4c42a030ba20 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1241 microversion: 2.1 time: 0.090741 Aug 19 15:28:45.924327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 329/649] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:45 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:28:46.793637 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0f46735f-058c-4507-b789-efe188906026 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:46.794869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0f46735f-058c-4507-b789-efe188906026 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:46.803381 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f46735f-058c-4507-b789-efe188906026 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:46.804097 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f46735f-058c-4507-b789-efe188906026 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:46.805339 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f46735f-058c-4507-b789-efe188906026 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:46.806142 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f46735f-058c-4507-b789-efe188906026 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:46.806595 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f46735f-058c-4507-b789-efe188906026 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:46.807011 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f46735f-058c-4507-b789-efe188906026 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:46.949367 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-55382745-df59-4889-8be0-06e05514eb9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:46.950674 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-55382745-df59-4889-8be0-06e05514eb9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:46.959886 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55382745-df59-4889-8be0-06e05514eb9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:46.960378 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55382745-df59-4889-8be0-06e05514eb9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:46.961057 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55382745-df59-4889-8be0-06e05514eb9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:46.961976 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55382745-df59-4889-8be0-06e05514eb9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:46.962696 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55382745-df59-4889-8be0-06e05514eb9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:46.964820 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55382745-df59-4889-8be0-06e05514eb9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:46.966991 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0f46735f-058c-4507-b789-efe188906026 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:46.975600 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0f46735f-058c-4507-b789-efe188906026 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1507 microversion: 2.1 time: 0.186063 Aug 19 15:28:46.976729 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 321/650] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:46 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:47.070260 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-55382745-df59-4889-8be0-06e05514eb9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:47.078778 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-55382745-df59-4889-8be0-06e05514eb9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1293 microversion: 2.1 time: 0.136672 Aug 19 15:28:47.079550 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 330/651] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:46 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1293 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:28:47.997798 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eae6a833-216c-4ca5-82b8-1429608e4afe tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:47.998362 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eae6a833-216c-4ca5-82b8-1429608e4afe tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:48.006053 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eae6a833-216c-4ca5-82b8-1429608e4afe tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:48.006743 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eae6a833-216c-4ca5-82b8-1429608e4afe tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:48.007166 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eae6a833-216c-4ca5-82b8-1429608e4afe tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:48.007850 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eae6a833-216c-4ca5-82b8-1429608e4afe tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:48.008289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eae6a833-216c-4ca5-82b8-1429608e4afe tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:48.009601 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eae6a833-216c-4ca5-82b8-1429608e4afe tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:48.101311 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6f92c68b-10af-435d-b6fd-04bd14593119 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:48.104206 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6f92c68b-10af-435d-b6fd-04bd14593119 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:48.120949 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f92c68b-10af-435d-b6fd-04bd14593119 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:48.121987 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f92c68b-10af-435d-b6fd-04bd14593119 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:48.125029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f92c68b-10af-435d-b6fd-04bd14593119 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:48.131154 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f92c68b-10af-435d-b6fd-04bd14593119 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:48.131807 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f92c68b-10af-435d-b6fd-04bd14593119 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:48.132917 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f92c68b-10af-435d-b6fd-04bd14593119 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:48.184954 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eae6a833-216c-4ca5-82b8-1429608e4afe tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:48.196822 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eae6a833-216c-4ca5-82b8-1429608e4afe tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 200 len: 1507 microversion: 2.1 time: 0.203194 Aug 19 15:28:48.197969 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 322/652] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:47 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 1507 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:48.204289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-1c9379ac-bba1-4a95-8829-a0ddc6114213 req-f9814c54-cc4b-4d74-99dd-35783d287d19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc81caa-949a-42ac-b696-7bb7cb9c5fd5", "tag": "8e0d422a-3a6d-4e22-8237-a99f06f45464"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:48.215180 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1c9379ac-bba1-4a95-8829-a0ddc6114213 req-f9814c54-cc4b-4d74-99dd-35783d287d19 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:48.215962 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1c9379ac-bba1-4a95-8829-a0ddc6114213 req-f9814c54-cc4b-4d74-99dd-35783d287d19 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:48.216590 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1c9379ac-bba1-4a95-8829-a0ddc6114213 req-f9814c54-cc4b-4d74-99dd-35783d287d19 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:48.229363 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-1c9379ac-bba1-4a95-8829-a0ddc6114213 req-f9814c54-cc4b-4d74-99dd-35783d287d19 service nova] Creating event network-changed:8e0d422a-3a6d-4e22-8237-a99f06f45464 for instance 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 on hv-cinder-83538 Aug 19 15:28:48.235983 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-1c9379ac-bba1-4a95-8829-a0ddc6114213 req-f9814c54-cc4b-4d74-99dd-35783d287d19 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035629 Aug 19 15:28:48.237242 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 323/653] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:48.243275 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6f92c68b-10af-435d-b6fd-04bd14593119 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:48.253073 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6f92c68b-10af-435d-b6fd-04bd14593119 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1299 microversion: 2.1 time: 0.157014 Aug 19 15:28:48.265207 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 331/654] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:48 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1299 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:49.222634 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-95aac37f-43f6-418e-b072-3d597f5d53f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:49.223369 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-95aac37f-43f6-418e-b072-3d597f5d53f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 9ac8d32c-fd72-4373-8957-3e1698b2dd3c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:49.237139 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95aac37f-43f6-418e-b072-3d597f5d53f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:49.238128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95aac37f-43f6-418e-b072-3d597f5d53f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:49.238851 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95aac37f-43f6-418e-b072-3d597f5d53f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:49.242689 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95aac37f-43f6-418e-b072-3d597f5d53f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:49.243171 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95aac37f-43f6-418e-b072-3d597f5d53f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:49.243604 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95aac37f-43f6-418e-b072-3d597f5d53f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:49.268609 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-95aac37f-43f6-418e-b072-3d597f5d53f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] HTTP exception thrown: Instance 9ac8d32c-fd72-4373-8957-3e1698b2dd3c could not be found. Aug 19 15:28:49.276437 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9a500f86-090b-4301-a186-943d0f547c9a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:49.277694 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9a500f86-090b-4301-a186-943d0f547c9a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-95aac37f-43f6-418e-b072-3d597f5d53f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Request method failure captured: Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c HTTP/1.1 Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6rldajWYu2a-wna4OYo7oT4PcVjfwOm5e53qr2wAzq1ke5P0YP7OvzwS0BQ7ZlWVHc9-8RfuQH42A1aK3RMPmXHvxct5oXkEXNEyZU87L546gCy6y0evh0UzcyVgOF-eIz1PDrc-6_6aRbz90Zhzpipvod_2wqGIrmzTxACvIsXGwY Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: dcca6c7d30114cd0936eb30381efad7d Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-592584515 Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:28:49.282825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:28:49.284541 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_dcca6c7d30114cd0936eb30381efad7d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcca6c7d30114cd0936eb30381efad7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcca6c7d30114cd0936eb30381efad7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/dcca6c7d30114cd0936eb30381efad7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:28:49.284541 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-ServerRescueNegativeTestJSON-592584515 Aug 19 15:28:49.284541 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: dcca6c7d30114cd0936eb30381efad7d Aug 19 15:28:49.284541 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-592584515 Aug 19 15:28:49.284541 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-ServerRescueNegativeTestJSON-592584515-project Aug 19 15:28:49.284541 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:28:49.284541 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:28:49.284541 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: 218f3dd17e6549fc8796eb30e4b48e24 Aug 19 15:28:49.284541 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-ServerRescueNegativeTestJSON-592584515-project Aug 19 15:28:49.284541 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:28:49.284541 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Instance 9ac8d32c-fd72-4373-8957-3e1698b2dd3c could not be found. Aug 19 15:28:49.284541 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': '9ac8d32c-fd72-4373-8957-3e1698b2dd3c'} Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ac8d32c-fd72-4373-8957-3e1698b2dd3c could not be found. Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:28:49.285975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:28:49.287461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:28:49.287461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:28:49.287461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:28:49.287461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:28:49.287461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:28:49.287461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:28:49.287461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:28:49.287461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ac8d32c-fd72-4373-8957-3e1698b2dd3c could not be found. Aug 19 15:28:49.287461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:28:49.287461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:28:49.287461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:28:49.287461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:28:49.287461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:28:49.287461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:28:49.287461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:28:49.287461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:28:49.287461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ac8d32c-fd72-4373-8957-3e1698b2dd3c could not be found. Aug 19 15:28:49.287461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:28:49.292523 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-95aac37f-43f6-418e-b072-3d597f5d53f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Returning 404 to user: Instance 9ac8d32c-fd72-4373-8957-3e1698b2dd3c could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:28:49.300126 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-95aac37f-43f6-418e-b072-3d597f5d53f2 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c" status: 404 len: 111 microversion: 2.1 time: 0.082014 Aug 19 15:28:49.302233 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a500f86-090b-4301-a186-943d0f547c9a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:49.302918 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a500f86-090b-4301-a186-943d0f547c9a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:49.303342 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 324/655] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:49 2022] GET /compute/v2.1/servers/9ac8d32c-fd72-4373-8957-3e1698b2dd3c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:28:49.303981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a500f86-090b-4301-a186-943d0f547c9a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:49.304764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a500f86-090b-4301-a186-943d0f547c9a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:49.305382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a500f86-090b-4301-a186-943d0f547c9a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:49.305967 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a500f86-090b-4301-a186-943d0f547c9a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:49.313823 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6b615dab-94e3-4773-88fd-3b683df98161 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:49.314571 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6b615dab-94e3-4773-88fd-3b683df98161 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:49.324178 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b615dab-94e3-4773-88fd-3b683df98161 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:49.328222 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b615dab-94e3-4773-88fd-3b683df98161 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:49.330066 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b615dab-94e3-4773-88fd-3b683df98161 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:49.331050 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b615dab-94e3-4773-88fd-3b683df98161 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:49.331670 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b615dab-94e3-4773-88fd-3b683df98161 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:49.341281 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b615dab-94e3-4773-88fd-3b683df98161 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:49.393149 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6b615dab-94e3-4773-88fd-3b683df98161 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:28:49.506065 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6b615dab-94e3-4773-88fd-3b683df98161 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "DELETE /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 204 len: 0 microversion: 2.1 time: 0.199427 Aug 19 15:28:49.510047 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 325/656] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:28:49 2022] DELETE /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 19 15:28:49.516935 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a6a971a2-5036-406f-8662-810d284ec591 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:49.517697 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a6a971a2-5036-406f-8662-810d284ec591 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:49.525330 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6a971a2-5036-406f-8662-810d284ec591 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:49.526004 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6a971a2-5036-406f-8662-810d284ec591 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:49.526902 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6a971a2-5036-406f-8662-810d284ec591 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:49.528378 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6a971a2-5036-406f-8662-810d284ec591 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:49.529040 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6a971a2-5036-406f-8662-810d284ec591 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:49.529810 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6a971a2-5036-406f-8662-810d284ec591 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:49.602331 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9a500f86-090b-4301-a186-943d0f547c9a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:49.615856 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9a500f86-090b-4301-a186-943d0f547c9a tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1367 microversion: 2.1 time: 0.343678 Aug 19 15:28:49.617049 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 332/657] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:49 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1367 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:28:49.716888 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a6a971a2-5036-406f-8662-810d284ec591 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:49.725564 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a6a971a2-5036-406f-8662-810d284ec591 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.213459 Aug 19 15:28:49.726134 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 326/658] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:49 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:49.845825 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bfbcb4cf-7637-4d83-86d1-0c5d9e854212 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1878551085"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:49.846392 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bfbcb4cf-7637-4d83-86d1-0c5d9e854212 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:49.852248 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfbcb4cf-7637-4d83-86d1-0c5d9e854212 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:49.852766 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfbcb4cf-7637-4d83-86d1-0c5d9e854212 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:49.853196 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfbcb4cf-7637-4d83-86d1-0c5d9e854212 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:49.853885 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfbcb4cf-7637-4d83-86d1-0c5d9e854212 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:49.854333 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfbcb4cf-7637-4d83-86d1-0c5d9e854212 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:49.854756 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfbcb4cf-7637-4d83-86d1-0c5d9e854212 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:49.989270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.network.security_group_api [None req-bfbcb4cf-7637-4d83-86d1-0c5d9e854212 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Adding security group 03329b8d-b452-4f81-b221-e26ad361f53c to port 8e0d422a-3a6d-4e22-8237-a99f06f45464 Aug 19 15:28:50.254888 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-4ea44881-e54a-4c4f-bc15-aa06faf8d0b5 req-dad20c43-f696-46df-85fa-9f3e17c74bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ac8d32c-fd72-4373-8957-3e1698b2dd3c", "name": "network-vif-deleted", "tag": "e851153e-06d0-452a-ac68-7efce3d3bf25"}, {"name": "network-changed", "server_uuid": "615eb3a5-68de-4e10-9e81-33393fa2b6cd", "tag": "a6d9816f-451f-44af-8263-ece906a39b8f"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:50.269606 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4ea44881-e54a-4c4f-bc15-aa06faf8d0b5 req-dad20c43-f696-46df-85fa-9f3e17c74bdf service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:50.270195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4ea44881-e54a-4c4f-bc15-aa06faf8d0b5 req-dad20c43-f696-46df-85fa-9f3e17c74bdf service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:50.270692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4ea44881-e54a-4c4f-bc15-aa06faf8d0b5 req-dad20c43-f696-46df-85fa-9f3e17c74bdf service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:50.283085 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-4ea44881-e54a-4c4f-bc15-aa06faf8d0b5 req-dad20c43-f696-46df-85fa-9f3e17c74bdf service nova] Creating event network-vif-deleted:e851153e-06d0-452a-ac68-7efce3d3bf25 for instance 9ac8d32c-fd72-4373-8957-3e1698b2dd3c on hv-cinder-83538 Aug 19 15:28:50.283521 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-4ea44881-e54a-4c4f-bc15-aa06faf8d0b5 req-dad20c43-f696-46df-85fa-9f3e17c74bdf service nova] Creating event network-changed:a6d9816f-451f-44af-8263-ece906a39b8f for instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd on hv-cinder-83538 Aug 19 15:28:50.289627 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-4ea44881-e54a-4c4f-bc15-aa06faf8d0b5 req-dad20c43-f696-46df-85fa-9f3e17c74bdf service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039037 Aug 19 15:28:50.290226 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 327/659] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:50.347481 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bfbcb4cf-7637-4d83-86d1-0c5d9e854212 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "POST /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5/action" status: 202 len: 0 microversion: 2.1 time: 0.506216 Aug 19 15:28:50.348415 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 333/660] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Aug 19 15:28:49 2022] POST /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:28:50.356931 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c037b73e-9003-4234-a009-89f06f94455c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:50.357624 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c037b73e-9003-4234-a009-89f06f94455c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:50.363855 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c037b73e-9003-4234-a009-89f06f94455c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:50.364337 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c037b73e-9003-4234-a009-89f06f94455c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:50.364813 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c037b73e-9003-4234-a009-89f06f94455c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:50.365500 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c037b73e-9003-4234-a009-89f06f94455c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:50.365948 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c037b73e-9003-4234-a009-89f06f94455c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:50.366369 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c037b73e-9003-4234-a009-89f06f94455c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:50.437335 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-c6a76b45-e675-48c0-9840-b5d87c7a04f1 req-ea39172f-cddc-43e5-a89f-f9aaf04f0de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc81caa-949a-42ac-b696-7bb7cb9c5fd5", "tag": "8e0d422a-3a6d-4e22-8237-a99f06f45464"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:50.448879 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c6a76b45-e675-48c0-9840-b5d87c7a04f1 req-ea39172f-cddc-43e5-a89f-f9aaf04f0de1 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:50.449630 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c6a76b45-e675-48c0-9840-b5d87c7a04f1 req-ea39172f-cddc-43e5-a89f-f9aaf04f0de1 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:50.450246 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c6a76b45-e675-48c0-9840-b5d87c7a04f1 req-ea39172f-cddc-43e5-a89f-f9aaf04f0de1 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:50.463952 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-c6a76b45-e675-48c0-9840-b5d87c7a04f1 req-ea39172f-cddc-43e5-a89f-f9aaf04f0de1 service nova] Creating event network-changed:8e0d422a-3a6d-4e22-8237-a99f06f45464 for instance 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 on hv-cinder-83538 Aug 19 15:28:50.469471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-c6a76b45-e675-48c0-9840-b5d87c7a04f1 req-ea39172f-cddc-43e5-a89f-f9aaf04f0de1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101104 Aug 19 15:28:50.470600 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 334/661] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:28:50.541357 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c037b73e-9003-4234-a009-89f06f94455c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:50.550914 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c037b73e-9003-4234-a009-89f06f94455c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1642 microversion: 2.1 time: 0.198160 Aug 19 15:28:50.551609 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 328/662] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:50 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1642 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:50.638238 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-50aee029-62fa-429e-aa5b-167e2c22b7d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:50.638933 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-50aee029-62fa-429e-aa5b-167e2c22b7d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:50.645293 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50aee029-62fa-429e-aa5b-167e2c22b7d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:50.645773 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50aee029-62fa-429e-aa5b-167e2c22b7d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:50.646202 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50aee029-62fa-429e-aa5b-167e2c22b7d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:50.646900 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50aee029-62fa-429e-aa5b-167e2c22b7d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:50.647352 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50aee029-62fa-429e-aa5b-167e2c22b7d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:50.647896 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50aee029-62fa-429e-aa5b-167e2c22b7d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:50.746461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3569162f-6920-441e-a1e4-6e70db04e0b8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:50.747062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3569162f-6920-441e-a1e4-6e70db04e0b8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:50.754011 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3569162f-6920-441e-a1e4-6e70db04e0b8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:50.754758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3569162f-6920-441e-a1e4-6e70db04e0b8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:50.755200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3569162f-6920-441e-a1e4-6e70db04e0b8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:50.755894 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3569162f-6920-441e-a1e4-6e70db04e0b8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:50.756366 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3569162f-6920-441e-a1e4-6e70db04e0b8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:50.756960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3569162f-6920-441e-a1e4-6e70db04e0b8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:50.790852 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-50aee029-62fa-429e-aa5b-167e2c22b7d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:50.799707 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-50aee029-62fa-429e-aa5b-167e2c22b7d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1367 microversion: 2.1 time: 0.165723 Aug 19 15:28:50.800592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 335/663] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:50 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:50.895928 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3569162f-6920-441e-a1e4-6e70db04e0b8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:50.903518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3569162f-6920-441e-a1e4-6e70db04e0b8 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.160875 Aug 19 15:28:50.904077 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 329/664] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:50 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:51.820382 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-262fb059-76e7-41a2-971a-8fde7ca62cbb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:51.821003 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-262fb059-76e7-41a2-971a-8fde7ca62cbb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:51.827445 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-262fb059-76e7-41a2-971a-8fde7ca62cbb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:51.827916 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-262fb059-76e7-41a2-971a-8fde7ca62cbb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:51.829144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-262fb059-76e7-41a2-971a-8fde7ca62cbb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:51.829828 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-262fb059-76e7-41a2-971a-8fde7ca62cbb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:51.830275 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-262fb059-76e7-41a2-971a-8fde7ca62cbb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:51.830719 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-262fb059-76e7-41a2-971a-8fde7ca62cbb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:51.925464 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ad3af3be-1719-4181-aa75-d5d3f180fb75 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:51.925976 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ad3af3be-1719-4181-aa75-d5d3f180fb75 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:51.932747 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad3af3be-1719-4181-aa75-d5d3f180fb75 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:51.933246 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad3af3be-1719-4181-aa75-d5d3f180fb75 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:51.933676 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad3af3be-1719-4181-aa75-d5d3f180fb75 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:51.934362 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad3af3be-1719-4181-aa75-d5d3f180fb75 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:51.934810 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad3af3be-1719-4181-aa75-d5d3f180fb75 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:51.935230 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad3af3be-1719-4181-aa75-d5d3f180fb75 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:51.963868 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-262fb059-76e7-41a2-971a-8fde7ca62cbb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:51.971853 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-262fb059-76e7-41a2-971a-8fde7ca62cbb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1367 microversion: 2.1 time: 0.155303 Aug 19 15:28:51.972462 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 336/665] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:51 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:52.069348 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ad3af3be-1719-4181-aa75-d5d3f180fb75 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:52.071605 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:52.078989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ad3af3be-1719-4181-aa75-d5d3f180fb75 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.157503 Aug 19 15:28:52.079610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 330/666] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:51 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:28:52.993649 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5ddb3096-9c82-4634-a635-9000ff776ea6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:52.994462 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5ddb3096-9c82-4634-a635-9000ff776ea6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:53.001231 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ddb3096-9c82-4634-a635-9000ff776ea6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:53.001714 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ddb3096-9c82-4634-a635-9000ff776ea6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:53.002149 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ddb3096-9c82-4634-a635-9000ff776ea6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:53.002889 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ddb3096-9c82-4634-a635-9000ff776ea6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:53.003348 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ddb3096-9c82-4634-a635-9000ff776ea6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:53.003823 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ddb3096-9c82-4634-a635-9000ff776ea6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:53.099759 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1116e2b2-eed8-468f-bccf-413957e16e6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:53.100371 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1116e2b2-eed8-468f-bccf-413957e16e6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:53.108202 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1116e2b2-eed8-468f-bccf-413957e16e6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:53.108734 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1116e2b2-eed8-468f-bccf-413957e16e6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:53.109155 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1116e2b2-eed8-468f-bccf-413957e16e6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:53.110131 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1116e2b2-eed8-468f-bccf-413957e16e6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:53.110590 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1116e2b2-eed8-468f-bccf-413957e16e6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:53.111009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1116e2b2-eed8-468f-bccf-413957e16e6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:53.141532 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5ddb3096-9c82-4634-a635-9000ff776ea6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:53.149128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5ddb3096-9c82-4634-a635-9000ff776ea6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1367 microversion: 2.1 time: 0.159363 Aug 19 15:28:53.157401 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 337/667] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:52 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:53.255399 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1116e2b2-eed8-468f-bccf-413957e16e6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:53.263370 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1116e2b2-eed8-468f-bccf-413957e16e6c tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1520 microversion: 2.1 time: 0.167418 Aug 19 15:28:53.263953 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 331/668] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:53 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:53.880969 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-cc6970d0-edeb-4974-b11d-0736c660e771 req-98698ad3-8461-4430-b412-486415db4e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c60ba0-a623-41bb-ba6c-e9ff6e6a4802", "name": "network-vif-deleted", "tag": "b97f032a-18f2-4b4c-aa4a-57e19ac342cd"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:28:53.895304 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-cc6970d0-edeb-4974-b11d-0736c660e771 req-98698ad3-8461-4430-b412-486415db4e2e service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:53.896023 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-cc6970d0-edeb-4974-b11d-0736c660e771 req-98698ad3-8461-4430-b412-486415db4e2e service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:53.896806 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-cc6970d0-edeb-4974-b11d-0736c660e771 req-98698ad3-8461-4430-b412-486415db4e2e service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:53.912884 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-cc6970d0-edeb-4974-b11d-0736c660e771 req-98698ad3-8461-4430-b412-486415db4e2e service nova] Creating event network-vif-deleted:b97f032a-18f2-4b4c-aa4a-57e19ac342cd for instance 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 on hv-cinder-83538 Aug 19 15:28:53.919928 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-cc6970d0-edeb-4974-b11d-0736c660e771 req-98698ad3-8461-4430-b412-486415db4e2e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043117 Aug 19 15:28:53.920833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 338/669] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:28:54.169342 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8aa0e5dd-2b4e-4608-a2c1-565d773248bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:54.169947 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8aa0e5dd-2b4e-4608-a2c1-565d773248bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:54.177464 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8aa0e5dd-2b4e-4608-a2c1-565d773248bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:54.177950 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8aa0e5dd-2b4e-4608-a2c1-565d773248bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:54.178382 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8aa0e5dd-2b4e-4608-a2c1-565d773248bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:54.179073 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8aa0e5dd-2b4e-4608-a2c1-565d773248bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:54.179530 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8aa0e5dd-2b4e-4608-a2c1-565d773248bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:54.179952 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8aa0e5dd-2b4e-4608-a2c1-565d773248bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:54.285848 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-61c71b07-7d9b-41a0-b71b-a36d52c025cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:54.286541 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-61c71b07-7d9b-41a0-b71b-a36d52c025cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:54.293138 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61c71b07-7d9b-41a0-b71b-a36d52c025cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:54.293625 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61c71b07-7d9b-41a0-b71b-a36d52c025cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:54.294056 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61c71b07-7d9b-41a0-b71b-a36d52c025cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:54.294745 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61c71b07-7d9b-41a0-b71b-a36d52c025cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:54.295253 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61c71b07-7d9b-41a0-b71b-a36d52c025cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:54.295697 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61c71b07-7d9b-41a0-b71b-a36d52c025cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:54.313875 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8aa0e5dd-2b4e-4608-a2c1-565d773248bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:54.321623 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8aa0e5dd-2b4e-4608-a2c1-565d773248bc tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1367 microversion: 2.1 time: 0.156123 Aug 19 15:28:54.322190 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 332/670] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:54 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:54.332105 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61c71b07-7d9b-41a0-b71b-a36d52c025cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:54.332622 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61c71b07-7d9b-41a0-b71b-a36d52c025cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:54.333050 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61c71b07-7d9b-41a0-b71b-a36d52c025cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:54.333517 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-61c71b07-7d9b-41a0-b71b-a36d52c025cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lazy-loading 'fault' on Instance uuid 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:28:54.374528 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-61c71b07-7d9b-41a0-b71b-a36d52c025cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f3dd17e6549fc8796eb30e4b48e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcca6c7d30114cd0936eb30381efad7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:54.377113 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:54.383522 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-61c71b07-7d9b-41a0-b71b-a36d52c025cd tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 200 len: 1311 microversion: 2.1 time: 0.102708 Aug 19 15:28:54.384076 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 339/671] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:54 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:28:55.342772 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f0347299-9e67-4f85-99c2-f77085713803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:55.343376 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f0347299-9e67-4f85-99c2-f77085713803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:55.350667 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0347299-9e67-4f85-99c2-f77085713803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:55.351083 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0347299-9e67-4f85-99c2-f77085713803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:55.351508 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0347299-9e67-4f85-99c2-f77085713803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:55.352209 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0347299-9e67-4f85-99c2-f77085713803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:55.352681 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0347299-9e67-4f85-99c2-f77085713803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:55.353095 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0347299-9e67-4f85-99c2-f77085713803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:55.405375 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a6f1a9d1-5519-4507-9225-522d9bd96775 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:55.406113 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a6f1a9d1-5519-4507-9225-522d9bd96775 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] [instance: 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:55.412842 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6f1a9d1-5519-4507-9225-522d9bd96775 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:55.413419 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6f1a9d1-5519-4507-9225-522d9bd96775 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:55.413855 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6f1a9d1-5519-4507-9225-522d9bd96775 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:55.414553 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6f1a9d1-5519-4507-9225-522d9bd96775 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:55.415003 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6f1a9d1-5519-4507-9225-522d9bd96775 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:55.415422 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6f1a9d1-5519-4507-9225-522d9bd96775 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:55.431947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-a6f1a9d1-5519-4507-9225-522d9bd96775 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] HTTP exception thrown: Instance 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 could not be found. Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a6f1a9d1-5519-4507-9225-522d9bd96775 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Request method failure captured: Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 HTTP/1.1 Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6rldajWYu2a-wna4OYo7oT4PcVjfwOm5e53qr2wAzq1ke5P0YP7OvzwS0BQ7ZlWVHc9-8RfuQH42A1aK3RMPmXHvxct5oXkEXNEyZU87L546gCy6y0evh0UzcyVgOF-eIz1PDrc-6_6aRbz90Zhzpipvod_2wqGIrmzTxACvIsXGwY Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: dcca6c7d30114cd0936eb30381efad7d Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-592584515 Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:28:55.433612 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:28:55.435136 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_dcca6c7d30114cd0936eb30381efad7d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcca6c7d30114cd0936eb30381efad7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcca6c7d30114cd0936eb30381efad7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/dcca6c7d30114cd0936eb30381efad7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:28:55.435136 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-592584515 Aug 19 15:28:55.435136 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: dcca6c7d30114cd0936eb30381efad7d Aug 19 15:28:55.435136 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-592584515 Aug 19 15:28:55.435136 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-ServerRescueNegativeTestJSON-592584515-project Aug 19 15:28:55.435136 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:28:55.435136 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:28:55.435136 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 218f3dd17e6549fc8796eb30e4b48e24 Aug 19 15:28:55.435136 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-592584515-project Aug 19 15:28:55.435136 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:28:55.435136 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 could not be found. Aug 19 15:28:55.435136 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': '10c60ba0-a623-41bb-ba6c-e9ff6e6a4802'} Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 could not be found. Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:28:55.436124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:28:55.438243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:28:55.438243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:28:55.438243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:28:55.438243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:28:55.438243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:28:55.438243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:28:55.438243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:28:55.438243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 could not be found. Aug 19 15:28:55.438243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:55.438243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:28:55.438243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:55.438243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:28:55.438243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:28:55.438243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:28:55.438243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:28:55.438243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:28:55.438243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 could not be found. Aug 19 15:28:55.438243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:28:55.440004 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a6f1a9d1-5519-4507-9225-522d9bd96775 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] Returning 404 to user: Instance 10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:28:55.440004 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a6f1a9d1-5519-4507-9225-522d9bd96775 tempest-ServerRescueNegativeTestJSON-592584515 tempest-ServerRescueNegativeTestJSON-592584515-project] 10.222.0.75 "GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802" status: 404 len: 111 microversion: 2.1 time: 0.033805 Aug 19 15:28:55.440004 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 340/672] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:55 2022] GET /compute/v2.1/servers/10c60ba0-a623-41bb-ba6c-e9ff6e6a4802 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 15:28:55.489275 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f0347299-9e67-4f85-99c2-f77085713803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:55.497193 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f0347299-9e67-4f85-99c2-f77085713803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1367 microversion: 2.1 time: 0.158257 Aug 19 15:28:55.497821 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 333/673] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:55 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:56.518303 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-306c06c8-0869-4dd0-a1b8-cfaf9d7a8b86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:56.519548 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-306c06c8-0869-4dd0-a1b8-cfaf9d7a8b86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:56.521586 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=6 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:56.527536 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-306c06c8-0869-4dd0-a1b8-cfaf9d7a8b86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:56.528412 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-306c06c8-0869-4dd0-a1b8-cfaf9d7a8b86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:56.529082 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-306c06c8-0869-4dd0-a1b8-cfaf9d7a8b86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:56.529978 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-306c06c8-0869-4dd0-a1b8-cfaf9d7a8b86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:56.530628 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-306c06c8-0869-4dd0-a1b8-cfaf9d7a8b86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:56.531107 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-306c06c8-0869-4dd0-a1b8-cfaf9d7a8b86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:56.666597 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-306c06c8-0869-4dd0-a1b8-cfaf9d7a8b86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:56.675460 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-306c06c8-0869-4dd0-a1b8-cfaf9d7a8b86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1367 microversion: 2.1 time: 0.161742 Aug 19 15:28:56.676295 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 341/674] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:56 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:57.699506 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f3b468ee-d0e3-43ab-9039-8716b27f8a6e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:57.700118 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f3b468ee-d0e3-43ab-9039-8716b27f8a6e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:57.702052 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:57.703008 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:57.711100 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3b468ee-d0e3-43ab-9039-8716b27f8a6e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:57.711591 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3b468ee-d0e3-43ab-9039-8716b27f8a6e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:57.712026 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3b468ee-d0e3-43ab-9039-8716b27f8a6e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:57.712755 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3b468ee-d0e3-43ab-9039-8716b27f8a6e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:57.713206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3b468ee-d0e3-43ab-9039-8716b27f8a6e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:57.713631 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3b468ee-d0e3-43ab-9039-8716b27f8a6e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:57.855474 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f3b468ee-d0e3-43ab-9039-8716b27f8a6e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:57.864947 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f3b468ee-d0e3-43ab-9039-8716b27f8a6e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1367 microversion: 2.1 time: 0.169242 Aug 19 15:28:57.865663 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 334/675] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:57 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:28:58.886040 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9ad2e3cf-764c-4c35-a508-df61a1dd2803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:28:58.886650 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9ad2e3cf-764c-4c35-a508-df61a1dd2803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:28:58.893945 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ad2e3cf-764c-4c35-a508-df61a1dd2803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:58.894430 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ad2e3cf-764c-4c35-a508-df61a1dd2803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:58.894864 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ad2e3cf-764c-4c35-a508-df61a1dd2803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:58.895561 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ad2e3cf-764c-4c35-a508-df61a1dd2803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:28:58.896039 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ad2e3cf-764c-4c35-a508-df61a1dd2803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:28:58.896517 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ad2e3cf-764c-4c35-a508-df61a1dd2803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:28:59.072606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9ad2e3cf-764c-4c35-a508-df61a1dd2803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:28:59.080941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9ad2e3cf-764c-4c35-a508-df61a1dd2803 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1367 microversion: 2.1 time: 0.198762 Aug 19 15:28:59.081767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 342/676] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:28:58 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:00.102373 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-306533de-275b-422a-a76e-dfc3f030e9a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:00.103205 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-306533de-275b-422a-a76e-dfc3f030e9a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:00.110498 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-306533de-275b-422a-a76e-dfc3f030e9a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:00.111734 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-306533de-275b-422a-a76e-dfc3f030e9a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:00.112323 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-306533de-275b-422a-a76e-dfc3f030e9a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:00.113474 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-306533de-275b-422a-a76e-dfc3f030e9a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:00.114067 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-306533de-275b-422a-a76e-dfc3f030e9a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:00.114601 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-306533de-275b-422a-a76e-dfc3f030e9a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:00.272270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-185cdb1d-b767-43e0-a872-be447e183e4b req-091fe161-8b93-4e52-bb8d-51ec897facff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "615eb3a5-68de-4e10-9e81-33393fa2b6cd", "name": "network-vif-plugged", "status": "completed", "tag": "a6d9816f-451f-44af-8263-ece906a39b8f"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:29:00.283490 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-185cdb1d-b767-43e0-a872-be447e183e4b req-091fe161-8b93-4e52-bb8d-51ec897facff service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:00.284231 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-185cdb1d-b767-43e0-a872-be447e183e4b req-091fe161-8b93-4e52-bb8d-51ec897facff service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:00.284927 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-185cdb1d-b767-43e0-a872-be447e183e4b req-091fe161-8b93-4e52-bb8d-51ec897facff service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:00.296547 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-185cdb1d-b767-43e0-a872-be447e183e4b req-091fe161-8b93-4e52-bb8d-51ec897facff service nova] Creating event network-vif-plugged:a6d9816f-451f-44af-8263-ece906a39b8f for instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd on hv-cinder-83538 Aug 19 15:29:00.303788 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-185cdb1d-b767-43e0-a872-be447e183e4b req-091fe161-8b93-4e52-bb8d-51ec897facff service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180742 Aug 19 15:29:00.304815 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 343/677] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:29:00.344850 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-306533de-275b-422a-a76e-dfc3f030e9a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:00.352849 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-306533de-275b-422a-a76e-dfc3f030e9a4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1367 microversion: 2.1 time: 0.255208 Aug 19 15:29:00.365571 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 335/678] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:00 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:00.814756 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-66e7d33d-15e2-4b21-8fdf-bdb9e6cb01ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:00.815331 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-66e7d33d-15e2-4b21-8fdf-bdb9e6cb01ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:00.821998 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66e7d33d-15e2-4b21-8fdf-bdb9e6cb01ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:00.822727 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66e7d33d-15e2-4b21-8fdf-bdb9e6cb01ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:00.823160 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66e7d33d-15e2-4b21-8fdf-bdb9e6cb01ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:00.823857 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66e7d33d-15e2-4b21-8fdf-bdb9e6cb01ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:00.824309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66e7d33d-15e2-4b21-8fdf-bdb9e6cb01ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:00.824782 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66e7d33d-15e2-4b21-8fdf-bdb9e6cb01ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:00.851938 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-66e7d33d-15e2-4b21-8fdf-bdb9e6cb01ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:29:00.945973 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-66e7d33d-15e2-4b21-8fdf-bdb9e6cb01ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "DELETE /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 204 len: 0 microversion: 2.1 time: 0.135569 Aug 19 15:29:00.946203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 344/679] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:29:00 2022] DELETE /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:29:00.954760 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e004d070-1ab1-4ca1-a022-3261b6dff6c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:00.955575 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e004d070-1ab1-4ca1-a022-3261b6dff6c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:00.961832 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e004d070-1ab1-4ca1-a022-3261b6dff6c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:00.962422 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e004d070-1ab1-4ca1-a022-3261b6dff6c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:00.963160 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e004d070-1ab1-4ca1-a022-3261b6dff6c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:00.963882 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e004d070-1ab1-4ca1-a022-3261b6dff6c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:00.964371 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e004d070-1ab1-4ca1-a022-3261b6dff6c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:00.964877 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e004d070-1ab1-4ca1-a022-3261b6dff6c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:01.113528 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e004d070-1ab1-4ca1-a022-3261b6dff6c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:01.127179 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e004d070-1ab1-4ca1-a022-3261b6dff6c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1576 microversion: 2.1 time: 0.175211 Aug 19 15:29:01.127179 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 336/680] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:00 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:29:01.378762 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ba87cb37-79f1-4c28-9c41-d04cc95a8a86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:01.380249 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ba87cb37-79f1-4c28-9c41-d04cc95a8a86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:01.389536 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba87cb37-79f1-4c28-9c41-d04cc95a8a86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:01.390030 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba87cb37-79f1-4c28-9c41-d04cc95a8a86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:01.390467 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba87cb37-79f1-4c28-9c41-d04cc95a8a86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:01.391216 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba87cb37-79f1-4c28-9c41-d04cc95a8a86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:01.391673 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba87cb37-79f1-4c28-9c41-d04cc95a8a86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:01.392095 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba87cb37-79f1-4c28-9c41-d04cc95a8a86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:01.580783 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ba87cb37-79f1-4c28-9c41-d04cc95a8a86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:01.588571 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ba87cb37-79f1-4c28-9c41-d04cc95a8a86 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1367 microversion: 2.1 time: 0.216640 Aug 19 15:29:01.589138 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 345/681] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:01 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:02.147762 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c67eef27-ecb6-416d-aa1c-733967627675 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:02.148358 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c67eef27-ecb6-416d-aa1c-733967627675 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:02.155116 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c67eef27-ecb6-416d-aa1c-733967627675 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:02.155649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c67eef27-ecb6-416d-aa1c-733967627675 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:02.156031 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c67eef27-ecb6-416d-aa1c-733967627675 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:02.157542 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c67eef27-ecb6-416d-aa1c-733967627675 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:02.158081 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c67eef27-ecb6-416d-aa1c-733967627675 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:02.158606 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c67eef27-ecb6-416d-aa1c-733967627675 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:02.311772 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c67eef27-ecb6-416d-aa1c-733967627675 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:02.324343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c67eef27-ecb6-416d-aa1c-733967627675 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1576 microversion: 2.1 time: 0.179931 Aug 19 15:29:02.325381 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 337/682] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:02 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:02.610611 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d15c88ba-91aa-4aa7-900c-bc42bab93cae tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:02.611894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d15c88ba-91aa-4aa7-900c-bc42bab93cae tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:02.618138 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d15c88ba-91aa-4aa7-900c-bc42bab93cae tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:02.618618 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d15c88ba-91aa-4aa7-900c-bc42bab93cae tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:02.619240 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d15c88ba-91aa-4aa7-900c-bc42bab93cae tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:02.620155 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d15c88ba-91aa-4aa7-900c-bc42bab93cae tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:02.620781 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d15c88ba-91aa-4aa7-900c-bc42bab93cae tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:02.621351 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d15c88ba-91aa-4aa7-900c-bc42bab93cae tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:02.795630 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d15c88ba-91aa-4aa7-900c-bc42bab93cae tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:02.805126 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d15c88ba-91aa-4aa7-900c-bc42bab93cae tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1367 microversion: 2.1 time: 0.199191 Aug 19 15:29:02.807272 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 346/683] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:02 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:03.347996 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6c8a78d4-859b-484c-be04-a5039fcc8066 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:03.348879 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6c8a78d4-859b-484c-be04-a5039fcc8066 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:03.357093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c8a78d4-859b-484c-be04-a5039fcc8066 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:03.362806 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c8a78d4-859b-484c-be04-a5039fcc8066 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:03.363366 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c8a78d4-859b-484c-be04-a5039fcc8066 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:03.364206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c8a78d4-859b-484c-be04-a5039fcc8066 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:03.364787 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c8a78d4-859b-484c-be04-a5039fcc8066 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:03.366498 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c8a78d4-859b-484c-be04-a5039fcc8066 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:03.629426 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6c8a78d4-859b-484c-be04-a5039fcc8066 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:03.639390 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6c8a78d4-859b-484c-be04-a5039fcc8066 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1576 microversion: 2.1 time: 0.296016 Aug 19 15:29:03.645087 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 338/684] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:03 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1576 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:03.828031 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1cc93d45-58a3-4528-bb63-77888ef6e8cb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:03.830987 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1cc93d45-58a3-4528-bb63-77888ef6e8cb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:03.838077 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cc93d45-58a3-4528-bb63-77888ef6e8cb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:03.838715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cc93d45-58a3-4528-bb63-77888ef6e8cb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:03.839256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cc93d45-58a3-4528-bb63-77888ef6e8cb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:03.840292 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cc93d45-58a3-4528-bb63-77888ef6e8cb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:03.840874 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cc93d45-58a3-4528-bb63-77888ef6e8cb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:03.841396 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cc93d45-58a3-4528-bb63-77888ef6e8cb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:03.989178 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1cc93d45-58a3-4528-bb63-77888ef6e8cb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:04.000758 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1cc93d45-58a3-4528-bb63-77888ef6e8cb tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1557 microversion: 2.1 time: 0.176451 Aug 19 15:29:04.002061 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 347/685] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:03 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1557 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:04.022199 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e73c13f4-ed32-43dc-bd49-ef24ad351274 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:04.022942 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e73c13f4-ed32-43dc-bd49-ef24ad351274 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:04.030287 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e73c13f4-ed32-43dc-bd49-ef24ad351274 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:04.031043 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e73c13f4-ed32-43dc-bd49-ef24ad351274 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:04.031783 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e73c13f4-ed32-43dc-bd49-ef24ad351274 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:04.032506 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e73c13f4-ed32-43dc-bd49-ef24ad351274 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:04.032960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e73c13f4-ed32-43dc-bd49-ef24ad351274 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:04.033384 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e73c13f4-ed32-43dc-bd49-ef24ad351274 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:04.115053 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e73c13f4-ed32-43dc-bd49-ef24ad351274 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096710 Aug 19 15:29:04.116189 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 339/686] 10.222.0.75 () {58 vars in 1275 bytes} [Fri Aug 19 15:29:04 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:29:04.662010 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0fbb1577-3ead-4cf0-a02f-b1303c47b382 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:04.662782 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0fbb1577-3ead-4cf0-a02f-b1303c47b382 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:04.676021 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fbb1577-3ead-4cf0-a02f-b1303c47b382 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:04.676898 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fbb1577-3ead-4cf0-a02f-b1303c47b382 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:04.677683 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fbb1577-3ead-4cf0-a02f-b1303c47b382 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:04.680809 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fbb1577-3ead-4cf0-a02f-b1303c47b382 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:04.684877 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fbb1577-3ead-4cf0-a02f-b1303c47b382 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:04.685452 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fbb1577-3ead-4cf0-a02f-b1303c47b382 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:04.807752 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0fbb1577-3ead-4cf0-a02f-b1303c47b382 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:04.816676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0fbb1577-3ead-4cf0-a02f-b1303c47b382 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1509 microversion: 2.1 time: 0.158544 Aug 19 15:29:04.817714 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 348/687] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:04 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:05.229760 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-29492b1a-103a-4c58-a291-25dfc869efac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Action: 'create', calling method: .version_select at 0x7fb5333d4a60>, body: {"keypair": {"name": "tempest-keypair-747024770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+MLXGpuLkJOLTCD9Kt7JcUoBg53oFNh8Te9F0/Bk+XkDq5xRaqx87Gmsoe1xfH/+kMlm4D31s2S+fNgEu4alI2psM8nKAbZocVtHkovLpYnyMzV3q0Hst6KqpOw6dggQ=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:29:05.264874 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-68c1200d-f172-4f63-90e3-d8114ba64324 req-3b8e3701-c994-4416-917b-d55d85bc25ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb210f1-d4a9-4f36-8880-0d17b7e81557", "name": "network-vif-deleted", "tag": "d6f269ef-65e3-4c71-9074-4a4034f13618"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:29:05.294649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-29492b1a-103a-4c58-a291-25dfc869efac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Getting quotas for project 981bbb7282bd40d0b5335280d5041fa5. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:29:05.308523 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-29492b1a-103a-4c58-a291-25dfc869efac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Getting quotas for user 821d38464cd3491e81e94d809930d076 and project 981bbb7282bd40d0b5335280d5041fa5. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:29:05.310938 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-68c1200d-f172-4f63-90e3-d8114ba64324 req-3b8e3701-c994-4416-917b-d55d85bc25ca service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:05.311581 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-68c1200d-f172-4f63-90e3-d8114ba64324 req-3b8e3701-c994-4416-917b-d55d85bc25ca service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:05.312276 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-68c1200d-f172-4f63-90e3-d8114ba64324 req-3b8e3701-c994-4416-917b-d55d85bc25ca service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:05.328097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-68c1200d-f172-4f63-90e3-d8114ba64324 req-3b8e3701-c994-4416-917b-d55d85bc25ca service nova] Creating event network-vif-deleted:d6f269ef-65e3-4c71-9074-4a4034f13618 for instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 on hv-cinder-83538 Aug 19 15:29:05.335282 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-68c1200d-f172-4f63-90e3-d8114ba64324 req-3b8e3701-c994-4416-917b-d55d85bc25ca service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080521 Aug 19 15:29:05.336599 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 349/688] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:29:05.350985 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-29492b1a-103a-4c58-a291-25dfc869efac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.208285 Aug 19 15:29:05.351596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 340/689] 10.222.0.75 () {62 vars in 1200 bytes} [Fri Aug 19 15:29:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 210 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 19 15:29:05.806333 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-32cf5e91-249c-4110-8342-39f3c1c1d817 req-f620fb67-a9d8-4a8d-a21e-b4cc3c56a4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "615eb3a5-68de-4e10-9e81-33393fa2b6cd", "tag": "a6d9816f-451f-44af-8263-ece906a39b8f"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:29:05.820055 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-32cf5e91-249c-4110-8342-39f3c1c1d817 req-f620fb67-a9d8-4a8d-a21e-b4cc3c56a4c5 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:05.820649 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-32cf5e91-249c-4110-8342-39f3c1c1d817 req-f620fb67-a9d8-4a8d-a21e-b4cc3c56a4c5 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:05.821314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-32cf5e91-249c-4110-8342-39f3c1c1d817 req-f620fb67-a9d8-4a8d-a21e-b4cc3c56a4c5 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:05.839446 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-32cf5e91-249c-4110-8342-39f3c1c1d817 req-f620fb67-a9d8-4a8d-a21e-b4cc3c56a4c5 service nova] Creating event network-changed:a6d9816f-451f-44af-8263-ece906a39b8f for instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd on hv-cinder-83538 Aug 19 15:29:05.846484 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-03dd6524-1c0d-4563-a3ae-863112ea0d41 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:05.847096 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-32cf5e91-249c-4110-8342-39f3c1c1d817 req-f620fb67-a9d8-4a8d-a21e-b4cc3c56a4c5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045542 Aug 19 15:29:05.847334 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-03dd6524-1c0d-4563-a3ae-863112ea0d41 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:05.853270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 350/690] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:29:05.856272 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03dd6524-1c0d-4563-a3ae-863112ea0d41 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:05.858883 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03dd6524-1c0d-4563-a3ae-863112ea0d41 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:05.862271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03dd6524-1c0d-4563-a3ae-863112ea0d41 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:05.863225 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03dd6524-1c0d-4563-a3ae-863112ea0d41 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:05.866158 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03dd6524-1c0d-4563-a3ae-863112ea0d41 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:05.866799 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03dd6524-1c0d-4563-a3ae-863112ea0d41 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:05.919065 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03dd6524-1c0d-4563-a3ae-863112ea0d41 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:05.919646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03dd6524-1c0d-4563-a3ae-863112ea0d41 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:05.920693 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03dd6524-1c0d-4563-a3ae-863112ea0d41 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:05.922826 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-03dd6524-1c0d-4563-a3ae-863112ea0d41 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lazy-loading 'fault' on Instance uuid cfb210f1-d4a9-4f36-8880-0d17b7e81557 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:29:05.976964 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-03dd6524-1c0d-4563-a3ae-863112ea0d41 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:05.989758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-03dd6524-1c0d-4563-a3ae-863112ea0d41 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 200 len: 1230 microversion: 2.1 time: 0.155645 Aug 19 15:29:05.990768 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 341/691] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:05 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 1230 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:07.013721 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-78f400b7-a6f3-4797-9a48-bb352a859faa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:07.014809 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-78f400b7-a6f3-4797-9a48-bb352a859faa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:07.022409 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78f400b7-a6f3-4797-9a48-bb352a859faa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:07.023060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78f400b7-a6f3-4797-9a48-bb352a859faa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:07.023558 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78f400b7-a6f3-4797-9a48-bb352a859faa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:07.024344 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78f400b7-a6f3-4797-9a48-bb352a859faa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:07.030599 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78f400b7-a6f3-4797-9a48-bb352a859faa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:07.031063 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78f400b7-a6f3-4797-9a48-bb352a859faa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:07.047796 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-78f400b7-a6f3-4797-9a48-bb352a859faa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] HTTP exception thrown: Instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 could not be found. Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-78f400b7-a6f3-4797-9a48-bb352a859faa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Request method failure captured: Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 HTTP/1.1 Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6t2N5QTS_4OCGB0jgRUs0TSZzo2gl9qPhLPBfZUSjIOkLupXAev8tE5hQIOymfGQCL91SiFPi0c0msCN6rExdOuO8GikczGQcNy4o6Ig8ye1xUwkhIWxI8WVn6lBSuaRTlucMzO_v8bDaIgxLgIVpePd86TxVoIBmJeV0XPCb-IPXQ Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: 0add00db6668475093f558e9700333d1 Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-TestVolumeBootPattern-422588122 Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:29:07.050028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:29:07.051675 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0add00db6668475093f558e9700333d1", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0add00db6668475093f558e9700333d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0add00db6668475093f558e9700333d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0add00db6668475093f558e9700333d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:29:07.051675 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-TestVolumeBootPattern-422588122 Aug 19 15:29:07.051675 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 0add00db6668475093f558e9700333d1 Aug 19 15:29:07.051675 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-TestVolumeBootPattern-422588122 Aug 19 15:29:07.051675 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-TestVolumeBootPattern-422588122-project Aug 19 15:29:07.051675 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:29:07.051675 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:29:07.051675 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: af3e7eea0b2840b79404b370382ab44a Aug 19 15:29:07.051675 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-TestVolumeBootPattern-422588122-project Aug 19 15:29:07.051675 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:29:07.051675 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 could not be found. Aug 19 15:29:07.051675 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': 'cfb210f1-d4a9-4f36-8880-0d17b7e81557'} Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 could not be found. Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:29:07.052689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:29:07.054309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:29:07.054309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:29:07.054309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:29:07.054309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:29:07.054309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:29:07.054309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:29:07.054309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:29:07.054309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 could not be found. Aug 19 15:29:07.054309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:07.054309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:29:07.054309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:07.054309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:29:07.054309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:29:07.054309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:29:07.054309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:29:07.054309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:29:07.054309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 could not be found. Aug 19 15:29:07.054309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:07.056533 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-78f400b7-a6f3-4797-9a48-bb352a859faa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Returning 404 to user: Instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:29:07.057405 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-78f400b7-a6f3-4797-9a48-bb352a859faa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 404 len: 111 microversion: 2.1 time: 0.049597 Aug 19 15:29:07.057978 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 351/692] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:07 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:29:07.175884 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-43f8355d-4451-40e0-87bd-0e08f35c99e6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1509162162", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1301407205", "security_groups": [{"name": "tempest-secgroup-smoke-614027275"}], "block_device_mapping_v2": [{"uuid": "88708637-bef6-40cc-9a68-12ea6ff3b3d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6ddc4f9f-3c90-4d2a-9cf9-1e79206f98a8"}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:29:07.301643 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-43f8355d-4451-40e0-87bd-0e08f35c99e6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] validate_networks() for [('6ddc4f9f-3c90-4d2a-9cf9-1e79206f98a8', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:29:07.813738 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-75f12176-4a89-4e9a-acf9-6c88d4d8bbcb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1502007635", "imageRef": "27174b76-85e7-4123-a2bc-847959ca59f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f06e0ad7-daca-4c6f-af5a-93d063934231"}], "security_groups": [{"name": "tempest-securitygroup--652420049"}], "key_name": "tempest-keypair-747024770", "user_data": "}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:29:07.839657 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-43f8355d-4451-40e0-87bd-0e08f35c99e6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:29:07.840293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-43f8355d-4451-40e0-87bd-0e08f35c99e6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:29:07.840896 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-43f8355d-4451-40e0-87bd-0e08f35c99e6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:29:07.841395 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-43f8355d-4451-40e0-87bd-0e08f35c99e6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:29:07.841893 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-43f8355d-4451-40e0-87bd-0e08f35c99e6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:29:07.851680 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43f8355d-4451-40e0-87bd-0e08f35c99e6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:07.852284 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43f8355d-4451-40e0-87bd-0e08f35c99e6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:07.852840 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43f8355d-4451-40e0-87bd-0e08f35c99e6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:07.853646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43f8355d-4451-40e0-87bd-0e08f35c99e6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:07.858706 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43f8355d-4451-40e0-87bd-0e08f35c99e6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:07.859237 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43f8355d-4451-40e0-87bd-0e08f35c99e6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:07.889061 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-43f8355d-4451-40e0-87bd-0e08f35c99e6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Getting quotas for project 0add00db6668475093f558e9700333d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:29:07.894166 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-43f8355d-4451-40e0-87bd-0e08f35c99e6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Getting quotas for user af3e7eea0b2840b79404b370382ab44a and project 0add00db6668475093f558e9700333d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:29:07.933861 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-75f12176-4a89-4e9a-acf9-6c88d4d8bbcb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] validate_networks() for [('f06e0ad7-daca-4c6f-af5a-93d063934231', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:29:07.987014 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-43f8355d-4451-40e0-87bd-0e08f35c99e6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:29:07.990267 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-43f8355d-4451-40e0-87bd-0e08f35c99e6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='88708637-bef6-40cc-9a68-12ea6ff3b3d2',volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:29:08.162593 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-43f8355d-4451-40e0-87bd-0e08f35c99e6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.991595 Aug 19 15:29:08.163527 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 342/693] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:29:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 15:29:08.176696 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-32221db1-f0cd-4796-8a7d-452ca86e2803 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:08.178436 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-32221db1-f0cd-4796-8a7d-452ca86e2803 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:08.248988 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-32221db1-f0cd-4796-8a7d-452ca86e2803 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:08.257287 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-32221db1-f0cd-4796-8a7d-452ca86e2803 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1095 microversion: 2.1 time: 0.087085 Aug 19 15:29:08.258042 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 343/694] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:08 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1095 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:29:08.495074 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-75f12176-4a89-4e9a-acf9-6c88d4d8bbcb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:29:08.495633 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-75f12176-4a89-4e9a-acf9-6c88d4d8bbcb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:29:08.496105 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-75f12176-4a89-4e9a-acf9-6c88d4d8bbcb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:29:08.496538 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-75f12176-4a89-4e9a-acf9-6c88d4d8bbcb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:29:08.496945 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-75f12176-4a89-4e9a-acf9-6c88d4d8bbcb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:29:08.507746 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75f12176-4a89-4e9a-acf9-6c88d4d8bbcb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:08.508228 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75f12176-4a89-4e9a-acf9-6c88d4d8bbcb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:08.508795 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75f12176-4a89-4e9a-acf9-6c88d4d8bbcb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:08.509739 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75f12176-4a89-4e9a-acf9-6c88d4d8bbcb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:08.510395 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75f12176-4a89-4e9a-acf9-6c88d4d8bbcb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:08.510815 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75f12176-4a89-4e9a-acf9-6c88d4d8bbcb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:08.529411 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-75f12176-4a89-4e9a-acf9-6c88d4d8bbcb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Getting quotas for project 981bbb7282bd40d0b5335280d5041fa5. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:29:08.533817 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-75f12176-4a89-4e9a-acf9-6c88d4d8bbcb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Getting quotas for user 821d38464cd3491e81e94d809930d076 and project 981bbb7282bd40d0b5335280d5041fa5. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:29:08.546712 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-75f12176-4a89-4e9a-acf9-6c88d4d8bbcb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:29:08.550050 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-75f12176-4a89-4e9a-acf9-6c88d4d8bbcb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27174b76-85e7-4123-a2bc-847959ca59f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:29:08.601843 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-75f12176-4a89-4e9a-acf9-6c88d4d8bbcb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.792647 Aug 19 15:29:08.602491 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 352/695] 10.222.0.75 () {62 vars in 1188 bytes} [Fri Aug 19 15:29:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 19 15:29:08.619972 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ce9b5415-df97-41c7-9248-fb93d7bafa92 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:08.624633 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ce9b5415-df97-41c7-9248-fb93d7bafa92 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:08.716499 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ce9b5415-df97-41c7-9248-fb93d7bafa92 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:08.726341 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ce9b5415-df97-41c7-9248-fb93d7bafa92 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:08.728475 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ce9b5415-df97-41c7-9248-fb93d7bafa92 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:08.729636 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ce9b5415-df97-41c7-9248-fb93d7bafa92 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1281 microversion: 2.20 time: 0.120252 Aug 19 15:29:08.730397 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 344/696] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:29:08 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1281 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:29:09.279509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8c63b0d3-9ea5-48e5-82ad-88fb00cf4f37 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:09.280367 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8c63b0d3-9ea5-48e5-82ad-88fb00cf4f37 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:09.288546 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c63b0d3-9ea5-48e5-82ad-88fb00cf4f37 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:09.289269 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c63b0d3-9ea5-48e5-82ad-88fb00cf4f37 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:09.289778 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c63b0d3-9ea5-48e5-82ad-88fb00cf4f37 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:09.290684 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c63b0d3-9ea5-48e5-82ad-88fb00cf4f37 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:09.291209 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c63b0d3-9ea5-48e5-82ad-88fb00cf4f37 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:09.291801 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c63b0d3-9ea5-48e5-82ad-88fb00cf4f37 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:09.362080 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8c63b0d3-9ea5-48e5-82ad-88fb00cf4f37 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:09.374806 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8c63b0d3-9ea5-48e5-82ad-88fb00cf4f37 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1211 microversion: 2.1 time: 0.099706 Aug 19 15:29:09.390761 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 353/697] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:09 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1211 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:09.753047 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-565023ff-b0fe-451d-8e07-20a9870116b7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:09.754234 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-565023ff-b0fe-451d-8e07-20a9870116b7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:09.767194 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-565023ff-b0fe-451d-8e07-20a9870116b7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:09.767705 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-565023ff-b0fe-451d-8e07-20a9870116b7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:09.769352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-565023ff-b0fe-451d-8e07-20a9870116b7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:09.770119 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-565023ff-b0fe-451d-8e07-20a9870116b7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:09.770582 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-565023ff-b0fe-451d-8e07-20a9870116b7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:09.771015 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-565023ff-b0fe-451d-8e07-20a9870116b7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:09.873945 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-565023ff-b0fe-451d-8e07-20a9870116b7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:09.883738 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-565023ff-b0fe-451d-8e07-20a9870116b7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:09.885684 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-565023ff-b0fe-451d-8e07-20a9870116b7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:09.887735 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-565023ff-b0fe-451d-8e07-20a9870116b7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1341 microversion: 2.20 time: 0.138550 Aug 19 15:29:09.901345 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 345/698] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:29:09 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1341 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:29:10.397839 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-713e07d2-1ffc-42ee-b137-3cda333ab40c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:10.398441 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-713e07d2-1ffc-42ee-b137-3cda333ab40c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:10.400888 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:10.406380 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-713e07d2-1ffc-42ee-b137-3cda333ab40c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:10.406876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-713e07d2-1ffc-42ee-b137-3cda333ab40c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:10.407310 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-713e07d2-1ffc-42ee-b137-3cda333ab40c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:10.408008 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-713e07d2-1ffc-42ee-b137-3cda333ab40c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:10.408510 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-713e07d2-1ffc-42ee-b137-3cda333ab40c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:10.408969 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-713e07d2-1ffc-42ee-b137-3cda333ab40c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:10.481356 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-713e07d2-1ffc-42ee-b137-3cda333ab40c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:10.490142 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-713e07d2-1ffc-42ee-b137-3cda333ab40c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1199 microversion: 2.1 time: 0.096205 Aug 19 15:29:10.490730 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 354/699] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:10 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1199 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:10.911862 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ef4931bb-abb1-4bec-8ab8-affcc6836c38 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:10.912499 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ef4931bb-abb1-4bec-8ab8-affcc6836c38 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:10.919104 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef4931bb-abb1-4bec-8ab8-affcc6836c38 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:10.919587 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef4931bb-abb1-4bec-8ab8-affcc6836c38 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:10.920017 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef4931bb-abb1-4bec-8ab8-affcc6836c38 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:10.920736 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef4931bb-abb1-4bec-8ab8-affcc6836c38 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:10.921183 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef4931bb-abb1-4bec-8ab8-affcc6836c38 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:10.921606 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef4931bb-abb1-4bec-8ab8-affcc6836c38 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:10.989998 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef4931bb-abb1-4bec-8ab8-affcc6836c38 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:10.998547 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef4931bb-abb1-4bec-8ab8-affcc6836c38 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:11.001591 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef4931bb-abb1-4bec-8ab8-affcc6836c38 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:11.003523 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ef4931bb-abb1-4bec-8ab8-affcc6836c38 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1339 microversion: 2.20 time: 0.095343 Aug 19 15:29:11.004575 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 346/700] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:29:10 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:29:11.513416 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7be68a0e-2301-4f7e-8ef8-ee46990eab8b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:11.514034 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7be68a0e-2301-4f7e-8ef8-ee46990eab8b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:11.522500 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7be68a0e-2301-4f7e-8ef8-ee46990eab8b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:11.523374 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7be68a0e-2301-4f7e-8ef8-ee46990eab8b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:11.523825 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7be68a0e-2301-4f7e-8ef8-ee46990eab8b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:11.524574 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7be68a0e-2301-4f7e-8ef8-ee46990eab8b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:11.525269 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7be68a0e-2301-4f7e-8ef8-ee46990eab8b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:11.526323 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7be68a0e-2301-4f7e-8ef8-ee46990eab8b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:11.735975 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7be68a0e-2301-4f7e-8ef8-ee46990eab8b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:11.744900 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7be68a0e-2301-4f7e-8ef8-ee46990eab8b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1266 microversion: 2.1 time: 0.237370 Aug 19 15:29:11.745740 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 355/701] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:11 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:12.026009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a100e354-f5e3-4448-9fd9-6a20510a62d6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:12.026612 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a100e354-f5e3-4448-9fd9-6a20510a62d6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:12.034016 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a100e354-f5e3-4448-9fd9-6a20510a62d6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:12.034502 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a100e354-f5e3-4448-9fd9-6a20510a62d6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:12.034929 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a100e354-f5e3-4448-9fd9-6a20510a62d6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:12.035635 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a100e354-f5e3-4448-9fd9-6a20510a62d6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:12.036078 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a100e354-f5e3-4448-9fd9-6a20510a62d6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:12.036526 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a100e354-f5e3-4448-9fd9-6a20510a62d6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:12.183877 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a100e354-f5e3-4448-9fd9-6a20510a62d6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:12.192274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a100e354-f5e3-4448-9fd9-6a20510a62d6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:12.193797 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a100e354-f5e3-4448-9fd9-6a20510a62d6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:12.194903 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a100e354-f5e3-4448-9fd9-6a20510a62d6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1406 microversion: 2.20 time: 0.172887 Aug 19 15:29:12.195462 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 347/702] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:29:12 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:29:12.422354 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-1c6ed3b2-7c52-4eab-90f1-063394b4638d req-b3f73ca6-0a5f-47da-bc6f-823b4269693b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a1ec3f-5819-42b2-8e3d-5d6327ba52f8", "tag": "cdfe8c13-bb9b-4403-9e35-60ecb60215b9"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:29:12.433115 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-1c6ed3b2-7c52-4eab-90f1-063394b4638d req-b3f73ca6-0a5f-47da-bc6f-823b4269693b service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:12.433592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-1c6ed3b2-7c52-4eab-90f1-063394b4638d req-b3f73ca6-0a5f-47da-bc6f-823b4269693b service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:12.434015 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-1c6ed3b2-7c52-4eab-90f1-063394b4638d req-b3f73ca6-0a5f-47da-bc6f-823b4269693b service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:12.445106 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-1c6ed3b2-7c52-4eab-90f1-063394b4638d req-b3f73ca6-0a5f-47da-bc6f-823b4269693b service nova] Creating event network-changed:cdfe8c13-bb9b-4403-9e35-60ecb60215b9 for instance 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 on hv-cinder-83538 Aug 19 15:29:12.449948 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-1c6ed3b2-7c52-4eab-90f1-063394b4638d req-b3f73ca6-0a5f-47da-bc6f-823b4269693b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031579 Aug 19 15:29:12.450561 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 356/703] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:29:12.648040 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d9b3d05f-5e95-480a-9050-0e205cbd318e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:12.648695 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d9b3d05f-5e95-480a-9050-0e205cbd318e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:12.654695 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9b3d05f-5e95-480a-9050-0e205cbd318e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:12.655190 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9b3d05f-5e95-480a-9050-0e205cbd318e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:12.655588 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9b3d05f-5e95-480a-9050-0e205cbd318e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:12.656320 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9b3d05f-5e95-480a-9050-0e205cbd318e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:12.656803 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9b3d05f-5e95-480a-9050-0e205cbd318e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:12.657224 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9b3d05f-5e95-480a-9050-0e205cbd318e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:12.685419 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d9b3d05f-5e95-480a-9050-0e205cbd318e tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/ips" status: 200 len: 145 microversion: 2.1 time: 0.041037 Aug 19 15:29:12.686009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 348/704] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Aug 19 15:29:12 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:29:12.767191 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-26e66873-2a59-429d-ab66-4c8e1e061253 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:12.767991 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-26e66873-2a59-429d-ab66-4c8e1e061253 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:12.774439 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26e66873-2a59-429d-ab66-4c8e1e061253 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:12.775020 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26e66873-2a59-429d-ab66-4c8e1e061253 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:12.775530 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26e66873-2a59-429d-ab66-4c8e1e061253 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:12.776315 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26e66873-2a59-429d-ab66-4c8e1e061253 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:12.776864 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26e66873-2a59-429d-ab66-4c8e1e061253 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:12.777354 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26e66873-2a59-429d-ab66-4c8e1e061253 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:12.934570 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-26e66873-2a59-429d-ab66-4c8e1e061253 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:12.963500 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-26e66873-2a59-429d-ab66-4c8e1e061253 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1266 microversion: 2.1 time: 0.195005 Aug 19 15:29:12.976758 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 357/705] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:12 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:13.170624 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e64fcbb1-1dc7-4519-8a3f-bb901914dc7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:29:13.175703 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e64fcbb1-1dc7-4519-8a3f-bb901914dc7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:13.179500 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:13.192045 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e64fcbb1-1dc7-4519-8a3f-bb901914dc7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:13.192917 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e64fcbb1-1dc7-4519-8a3f-bb901914dc7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:13.193665 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e64fcbb1-1dc7-4519-8a3f-bb901914dc7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:13.195194 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e64fcbb1-1dc7-4519-8a3f-bb901914dc7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:13.195985 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e64fcbb1-1dc7-4519-8a3f-bb901914dc7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:13.196978 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e64fcbb1-1dc7-4519-8a3f-bb901914dc7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:13.220492 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-52abc1be-f337-434e-960f-2bcb0d39b7c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:13.221682 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-52abc1be-f337-434e-960f-2bcb0d39b7c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:13.232973 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52abc1be-f337-434e-960f-2bcb0d39b7c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:13.233682 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52abc1be-f337-434e-960f-2bcb0d39b7c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:13.235102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52abc1be-f337-434e-960f-2bcb0d39b7c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:13.236894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52abc1be-f337-434e-960f-2bcb0d39b7c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:13.237699 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52abc1be-f337-434e-960f-2bcb0d39b7c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:13.238894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52abc1be-f337-434e-960f-2bcb0d39b7c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:13.304806 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e64fcbb1-1dc7-4519-8a3f-bb901914dc7d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "POST /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5/action" status: 202 len: 0 microversion: 2.1 time: 0.140708 Aug 19 15:29:13.308365 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 349/706] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Aug 19 15:29:13 2022] POST /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:29:13.314395 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4521c166-bc3a-4b52-9446-06a7285cfcf7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:13.315086 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4521c166-bc3a-4b52-9446-06a7285cfcf7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:13.321414 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4521c166-bc3a-4b52-9446-06a7285cfcf7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:13.322043 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4521c166-bc3a-4b52-9446-06a7285cfcf7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:13.322480 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4521c166-bc3a-4b52-9446-06a7285cfcf7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:13.323162 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4521c166-bc3a-4b52-9446-06a7285cfcf7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:13.323608 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4521c166-bc3a-4b52-9446-06a7285cfcf7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:13.324027 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4521c166-bc3a-4b52-9446-06a7285cfcf7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:13.339059 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:13.435523 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-52abc1be-f337-434e-960f-2bcb0d39b7c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:13.444562 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-52abc1be-f337-434e-960f-2bcb0d39b7c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:13.446130 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-52abc1be-f337-434e-960f-2bcb0d39b7c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:13.447239 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-52abc1be-f337-434e-960f-2bcb0d39b7c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1406 microversion: 2.20 time: 0.233834 Aug 19 15:29:13.447796 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 358/707] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:29:13 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 15:29:13.500275 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4521c166-bc3a-4b52-9446-06a7285cfcf7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:13.509279 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4521c166-bc3a-4b52-9446-06a7285cfcf7 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1753 microversion: 2.1 time: 0.199462 Aug 19 15:29:13.509911 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 350/708] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:13 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1753 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:13.987527 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ba9f7df0-1d1d-4583-baf5-47fa5df30bf6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:13.988126 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ba9f7df0-1d1d-4583-baf5-47fa5df30bf6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:13.994529 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba9f7df0-1d1d-4583-baf5-47fa5df30bf6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:13.995008 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba9f7df0-1d1d-4583-baf5-47fa5df30bf6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:13.995431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba9f7df0-1d1d-4583-baf5-47fa5df30bf6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:13.996113 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba9f7df0-1d1d-4583-baf5-47fa5df30bf6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:13.996586 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba9f7df0-1d1d-4583-baf5-47fa5df30bf6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:13.997003 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba9f7df0-1d1d-4583-baf5-47fa5df30bf6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:14.012325 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:14.083579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1590d644-7c14-4f9e-bf32-3e5db74a5742 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11a57969-cc6b-4a26-8aa9-a7777fd1e990"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:29:14.086022 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1590d644-7c14-4f9e-bf32-3e5db74a5742 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:14.092178 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1590d644-7c14-4f9e-bf32-3e5db74a5742 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:14.092700 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1590d644-7c14-4f9e-bf32-3e5db74a5742 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:14.093143 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1590d644-7c14-4f9e-bf32-3e5db74a5742 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:14.094507 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1590d644-7c14-4f9e-bf32-3e5db74a5742 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:14.095317 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1590d644-7c14-4f9e-bf32-3e5db74a5742 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:14.095933 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1590d644-7c14-4f9e-bf32-3e5db74a5742 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:14.152658 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ba9f7df0-1d1d-4583-baf5-47fa5df30bf6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:14.161491 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ba9f7df0-1d1d-4583-baf5-47fa5df30bf6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1266 microversion: 2.1 time: 0.178218 Aug 19 15:29:14.162642 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 359/709] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:13 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:14.365378 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1590d644-7c14-4f9e-bf32-3e5db74a5742 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "POST /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286120 Aug 19 15:29:14.366125 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 351/710] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Aug 19 15:29:14 2022] POST /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:29:14.470151 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-18ec7718-384e-419b-b1e9-00d8b88eb939 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:14.470757 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-18ec7718-384e-419b-b1e9-00d8b88eb939 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:14.477643 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18ec7718-384e-419b-b1e9-00d8b88eb939 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:14.478065 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18ec7718-384e-419b-b1e9-00d8b88eb939 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:14.478495 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18ec7718-384e-419b-b1e9-00d8b88eb939 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:14.479221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18ec7718-384e-419b-b1e9-00d8b88eb939 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:14.479636 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18ec7718-384e-419b-b1e9-00d8b88eb939 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:14.480055 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18ec7718-384e-419b-b1e9-00d8b88eb939 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:14.486745 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-2c5e5a28-977c-4841-a6dc-42ac6b76fb54 req-d7517eb0-c196-473a-adbe-2376b3a5f113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08b2c2fe-ead2-4d92-b4fb-dc42b41094fd", "tag": "5bf9b7d8-d705-4190-bd01-29213ebc351a"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:29:14.496989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2c5e5a28-977c-4841-a6dc-42ac6b76fb54 req-d7517eb0-c196-473a-adbe-2376b3a5f113 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:14.497572 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2c5e5a28-977c-4841-a6dc-42ac6b76fb54 req-d7517eb0-c196-473a-adbe-2376b3a5f113 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:14.498233 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2c5e5a28-977c-4841-a6dc-42ac6b76fb54 req-d7517eb0-c196-473a-adbe-2376b3a5f113 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:14.511104 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-2c5e5a28-977c-4841-a6dc-42ac6b76fb54 req-d7517eb0-c196-473a-adbe-2376b3a5f113 service nova] Creating event network-changed:5bf9b7d8-d705-4190-bd01-29213ebc351a for instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd on hv-cinder-83538 Aug 19 15:29:14.517760 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-2c5e5a28-977c-4841-a6dc-42ac6b76fb54 req-d7517eb0-c196-473a-adbe-2376b3a5f113 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038186 Aug 19 15:29:14.518475 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 352/711] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:29:14.532709 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d0ca4edb-dd6a-474b-86b2-78cb8046015b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:14.533409 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d0ca4edb-dd6a-474b-86b2-78cb8046015b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:14.539743 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0ca4edb-dd6a-474b-86b2-78cb8046015b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:14.540221 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0ca4edb-dd6a-474b-86b2-78cb8046015b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:14.540676 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0ca4edb-dd6a-474b-86b2-78cb8046015b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:14.541371 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0ca4edb-dd6a-474b-86b2-78cb8046015b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:14.541818 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0ca4edb-dd6a-474b-86b2-78cb8046015b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:14.542244 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0ca4edb-dd6a-474b-86b2-78cb8046015b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:14.657272 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-18ec7718-384e-419b-b1e9-00d8b88eb939 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:14.666057 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-18ec7718-384e-419b-b1e9-00d8b88eb939 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:14.667497 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-18ec7718-384e-419b-b1e9-00d8b88eb939 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:14.668652 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-18ec7718-384e-419b-b1e9-00d8b88eb939 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1406 microversion: 2.20 time: 0.202739 Aug 19 15:29:14.669403 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 360/712] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:29:14 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:29:14.724384 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d0ca4edb-dd6a-474b-86b2-78cb8046015b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:14.732567 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d0ca4edb-dd6a-474b-86b2-78cb8046015b tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1753 microversion: 2.1 time: 0.204421 Aug 19 15:29:14.733130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 353/713] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:14 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1753 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:29:15.182451 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-24cdfa5b-bec4-4c9b-82dd-860c5191aa63 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:15.183089 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-24cdfa5b-bec4-4c9b-82dd-860c5191aa63 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:15.190008 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24cdfa5b-bec4-4c9b-82dd-860c5191aa63 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:15.190484 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24cdfa5b-bec4-4c9b-82dd-860c5191aa63 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:15.190916 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24cdfa5b-bec4-4c9b-82dd-860c5191aa63 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:15.191599 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24cdfa5b-bec4-4c9b-82dd-860c5191aa63 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:15.192051 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24cdfa5b-bec4-4c9b-82dd-860c5191aa63 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:15.192501 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24cdfa5b-bec4-4c9b-82dd-860c5191aa63 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:15.330369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-24cdfa5b-bec4-4c9b-82dd-860c5191aa63 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:15.338701 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-24cdfa5b-bec4-4c9b-82dd-860c5191aa63 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1266 microversion: 2.1 time: 0.160100 Aug 19 15:29:15.339280 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 361/714] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:15 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:15.692776 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a41233ce-4345-429c-9807-990d3810222e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:15.693377 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a41233ce-4345-429c-9807-990d3810222e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:15.701196 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a41233ce-4345-429c-9807-990d3810222e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:15.701679 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a41233ce-4345-429c-9807-990d3810222e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:15.702110 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a41233ce-4345-429c-9807-990d3810222e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:15.702889 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a41233ce-4345-429c-9807-990d3810222e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:15.703751 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a41233ce-4345-429c-9807-990d3810222e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:15.704811 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a41233ce-4345-429c-9807-990d3810222e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:15.757426 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-447dcba0-28f8-496b-9098-a40e25ba0947 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:15.763931 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-447dcba0-28f8-496b-9098-a40e25ba0947 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:15.774001 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-447dcba0-28f8-496b-9098-a40e25ba0947 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:15.774494 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-447dcba0-28f8-496b-9098-a40e25ba0947 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:15.774927 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-447dcba0-28f8-496b-9098-a40e25ba0947 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:15.780722 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-447dcba0-28f8-496b-9098-a40e25ba0947 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:15.781792 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-447dcba0-28f8-496b-9098-a40e25ba0947 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:15.782232 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-447dcba0-28f8-496b-9098-a40e25ba0947 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:15.926300 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a41233ce-4345-429c-9807-990d3810222e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:15.935814 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a41233ce-4345-429c-9807-990d3810222e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:15.937942 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a41233ce-4345-429c-9807-990d3810222e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:15.939290 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a41233ce-4345-429c-9807-990d3810222e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1406 microversion: 2.20 time: 0.251958 Aug 19 15:29:15.939946 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 354/715] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:29:15 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1406 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:29:15.966950 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-447dcba0-28f8-496b-9098-a40e25ba0947 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:15.976048 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-447dcba0-28f8-496b-9098-a40e25ba0947 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1758 microversion: 2.1 time: 0.226125 Aug 19 15:29:15.976760 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 362/716] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:15 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1758 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:16.360792 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-20099ec1-50f3-405e-9707-fcb45edc0fa6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:16.361398 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-20099ec1-50f3-405e-9707-fcb45edc0fa6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:16.367745 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20099ec1-50f3-405e-9707-fcb45edc0fa6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:16.368219 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20099ec1-50f3-405e-9707-fcb45edc0fa6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:16.368674 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20099ec1-50f3-405e-9707-fcb45edc0fa6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:16.369345 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20099ec1-50f3-405e-9707-fcb45edc0fa6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:16.369782 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20099ec1-50f3-405e-9707-fcb45edc0fa6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:16.370195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20099ec1-50f3-405e-9707-fcb45edc0fa6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:16.505607 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-20099ec1-50f3-405e-9707-fcb45edc0fa6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:16.515174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-20099ec1-50f3-405e-9707-fcb45edc0fa6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1266 microversion: 2.1 time: 0.159258 Aug 19 15:29:16.515791 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 355/717] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:16 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:16.961819 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-970a6a8d-672b-4c84-875f-c238f752c838 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:16.962338 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-970a6a8d-672b-4c84-875f-c238f752c838 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:16.969534 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-970a6a8d-672b-4c84-875f-c238f752c838 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:16.970015 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-970a6a8d-672b-4c84-875f-c238f752c838 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:16.970446 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-970a6a8d-672b-4c84-875f-c238f752c838 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:16.971137 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-970a6a8d-672b-4c84-875f-c238f752c838 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:16.971583 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-970a6a8d-672b-4c84-875f-c238f752c838 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:16.971999 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-970a6a8d-672b-4c84-875f-c238f752c838 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:16.997867 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9acfe05d-b5fd-4699-b199-cfb8aa567c25 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:16.998475 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9acfe05d-b5fd-4699-b199-cfb8aa567c25 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:17.004547 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9acfe05d-b5fd-4699-b199-cfb8aa567c25 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:17.005039 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9acfe05d-b5fd-4699-b199-cfb8aa567c25 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:17.005471 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9acfe05d-b5fd-4699-b199-cfb8aa567c25 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:17.006168 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9acfe05d-b5fd-4699-b199-cfb8aa567c25 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:17.006613 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9acfe05d-b5fd-4699-b199-cfb8aa567c25 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:17.007032 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9acfe05d-b5fd-4699-b199-cfb8aa567c25 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:17.158085 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-970a6a8d-672b-4c84-875f-c238f752c838 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:17.166642 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-970a6a8d-672b-4c84-875f-c238f752c838 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:17.168160 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-970a6a8d-672b-4c84-875f-c238f752c838 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:17.169332 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-970a6a8d-672b-4c84-875f-c238f752c838 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1406 microversion: 2.20 time: 0.211507 Aug 19 15:29:17.169874 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 363/718] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:29:16 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:29:17.200103 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9acfe05d-b5fd-4699-b199-cfb8aa567c25 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:17.209086 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9acfe05d-b5fd-4699-b199-cfb8aa567c25 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1758 microversion: 2.1 time: 0.214980 Aug 19 15:29:17.209655 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 356/719] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:16 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1758 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:29:17.536320 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c80a8641-84ac-4d0e-a3dc-dd6a01aef08f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:17.536977 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c80a8641-84ac-4d0e-a3dc-dd6a01aef08f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:17.543041 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c80a8641-84ac-4d0e-a3dc-dd6a01aef08f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:17.543516 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c80a8641-84ac-4d0e-a3dc-dd6a01aef08f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:17.543946 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c80a8641-84ac-4d0e-a3dc-dd6a01aef08f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:17.544664 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c80a8641-84ac-4d0e-a3dc-dd6a01aef08f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:17.545114 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c80a8641-84ac-4d0e-a3dc-dd6a01aef08f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:17.545535 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c80a8641-84ac-4d0e-a3dc-dd6a01aef08f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:17.687166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c80a8641-84ac-4d0e-a3dc-dd6a01aef08f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:17.695537 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c80a8641-84ac-4d0e-a3dc-dd6a01aef08f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1266 microversion: 2.1 time: 0.163039 Aug 19 15:29:17.696133 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 364/720] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:17 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:18.191653 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-84cabe2b-aa85-44dd-b4a8-f2370b47b0ee tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:18.192301 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-84cabe2b-aa85-44dd-b4a8-f2370b47b0ee tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:18.195922 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:18.200225 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84cabe2b-aa85-44dd-b4a8-f2370b47b0ee tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:18.201139 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84cabe2b-aa85-44dd-b4a8-f2370b47b0ee tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:18.201570 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84cabe2b-aa85-44dd-b4a8-f2370b47b0ee tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:18.202276 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84cabe2b-aa85-44dd-b4a8-f2370b47b0ee tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:18.202736 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84cabe2b-aa85-44dd-b4a8-f2370b47b0ee tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:18.203885 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84cabe2b-aa85-44dd-b4a8-f2370b47b0ee tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:18.230721 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-368415a3-34f8-4c41-bc2e-d2ca1ddc620f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:18.231504 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-368415a3-34f8-4c41-bc2e-d2ca1ddc620f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:18.238280 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-368415a3-34f8-4c41-bc2e-d2ca1ddc620f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:18.239215 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-368415a3-34f8-4c41-bc2e-d2ca1ddc620f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:18.239893 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-368415a3-34f8-4c41-bc2e-d2ca1ddc620f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:18.240786 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-368415a3-34f8-4c41-bc2e-d2ca1ddc620f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:18.241409 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-368415a3-34f8-4c41-bc2e-d2ca1ddc620f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:18.241836 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-368415a3-34f8-4c41-bc2e-d2ca1ddc620f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:18.391466 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-84cabe2b-aa85-44dd-b4a8-f2370b47b0ee tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:18.399575 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-84cabe2b-aa85-44dd-b4a8-f2370b47b0ee tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:18.404534 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-84cabe2b-aa85-44dd-b4a8-f2370b47b0ee tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:18.405655 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-84cabe2b-aa85-44dd-b4a8-f2370b47b0ee tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1406 microversion: 2.20 time: 0.218479 Aug 19 15:29:18.406329 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 357/721] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:29:18 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:29:18.431919 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-368415a3-34f8-4c41-bc2e-d2ca1ddc620f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:18.440791 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-368415a3-34f8-4c41-bc2e-d2ca1ddc620f tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1758 microversion: 2.1 time: 0.214326 Aug 19 15:29:18.441355 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 365/722] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:18 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1758 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:18.716361 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-60504c04-4350-48f7-914a-c41c5f136fb3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:18.716987 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-60504c04-4350-48f7-914a-c41c5f136fb3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:18.723504 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60504c04-4350-48f7-914a-c41c5f136fb3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:18.723984 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60504c04-4350-48f7-914a-c41c5f136fb3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:18.724426 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60504c04-4350-48f7-914a-c41c5f136fb3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:18.725112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60504c04-4350-48f7-914a-c41c5f136fb3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:18.725558 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60504c04-4350-48f7-914a-c41c5f136fb3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:18.725972 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60504c04-4350-48f7-914a-c41c5f136fb3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:18.726400 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=14 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:18.857052 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-60504c04-4350-48f7-914a-c41c5f136fb3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:18.865299 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-60504c04-4350-48f7-914a-c41c5f136fb3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1266 microversion: 2.1 time: 0.152802 Aug 19 15:29:18.865863 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 358/723] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:18 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:19.428881 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f7b979b7-4aac-4e62-8ddc-178bd4c3f1bb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:19.429487 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f7b979b7-4aac-4e62-8ddc-178bd4c3f1bb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:19.431325 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:19.431982 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=6 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:19.440054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7b979b7-4aac-4e62-8ddc-178bd4c3f1bb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:19.440572 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7b979b7-4aac-4e62-8ddc-178bd4c3f1bb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:19.441001 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7b979b7-4aac-4e62-8ddc-178bd4c3f1bb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:19.441715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7b979b7-4aac-4e62-8ddc-178bd4c3f1bb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:19.442161 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7b979b7-4aac-4e62-8ddc-178bd4c3f1bb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:19.442575 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7b979b7-4aac-4e62-8ddc-178bd4c3f1bb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:19.461116 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2bc35dc3-e500-420a-b12e-e01d655da2af tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:19.461721 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2bc35dc3-e500-420a-b12e-e01d655da2af tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:19.468304 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bc35dc3-e500-420a-b12e-e01d655da2af tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:19.469417 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bc35dc3-e500-420a-b12e-e01d655da2af tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:19.469944 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bc35dc3-e500-420a-b12e-e01d655da2af tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:19.470676 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bc35dc3-e500-420a-b12e-e01d655da2af tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:19.471126 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bc35dc3-e500-420a-b12e-e01d655da2af tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:19.471585 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bc35dc3-e500-420a-b12e-e01d655da2af tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:19.650198 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f7b979b7-4aac-4e62-8ddc-178bd4c3f1bb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:19.659578 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f7b979b7-4aac-4e62-8ddc-178bd4c3f1bb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:19.661104 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f7b979b7-4aac-4e62-8ddc-178bd4c3f1bb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:19.662202 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f7b979b7-4aac-4e62-8ddc-178bd4c3f1bb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1406 microversion: 2.20 time: 0.237323 Aug 19 15:29:19.662756 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 366/724] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:29:19 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:29:19.663547 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2bc35dc3-e500-420a-b12e-e01d655da2af tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:19.672703 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2bc35dc3-e500-420a-b12e-e01d655da2af tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1758 microversion: 2.1 time: 0.214748 Aug 19 15:29:19.673450 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 359/725] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:19 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1758 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:29:19.885550 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-39e9ef92-e533-438e-aeab-03e4bbf02fcb tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:19.886233 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-39e9ef92-e533-438e-aeab-03e4bbf02fcb tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:19.893152 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39e9ef92-e533-438e-aeab-03e4bbf02fcb tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:19.893629 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39e9ef92-e533-438e-aeab-03e4bbf02fcb tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:19.894054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39e9ef92-e533-438e-aeab-03e4bbf02fcb tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:19.894740 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39e9ef92-e533-438e-aeab-03e4bbf02fcb tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:19.895206 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39e9ef92-e533-438e-aeab-03e4bbf02fcb tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:19.895605 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39e9ef92-e533-438e-aeab-03e4bbf02fcb tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:20.025445 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-39e9ef92-e533-438e-aeab-03e4bbf02fcb tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:20.033680 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-39e9ef92-e533-438e-aeab-03e4bbf02fcb tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1266 microversion: 2.1 time: 0.151993 Aug 19 15:29:20.034238 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 367/726] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:19 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:20.210504 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-24225d08-2b0c-448c-b0af-9381a32736e0 req-2a230f3f-ad9c-4516-b262-68be984f0136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b2c2fe-ead2-4d92-b4fb-dc42b41094fd", "name": "network-vif-plugged", "status": "completed", "tag": "5bf9b7d8-d705-4190-bd01-29213ebc351a"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:29:20.220599 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-24225d08-2b0c-448c-b0af-9381a32736e0 req-2a230f3f-ad9c-4516-b262-68be984f0136 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:20.221081 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-24225d08-2b0c-448c-b0af-9381a32736e0 req-2a230f3f-ad9c-4516-b262-68be984f0136 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:20.221512 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-24225d08-2b0c-448c-b0af-9381a32736e0 req-2a230f3f-ad9c-4516-b262-68be984f0136 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:20.232965 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-24225d08-2b0c-448c-b0af-9381a32736e0 req-2a230f3f-ad9c-4516-b262-68be984f0136 service nova] Creating event network-vif-plugged:5bf9b7d8-d705-4190-bd01-29213ebc351a for instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd on hv-cinder-83538 Aug 19 15:29:20.238235 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-24225d08-2b0c-448c-b0af-9381a32736e0 req-2a230f3f-ad9c-4516-b262-68be984f0136 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031493 Aug 19 15:29:20.239056 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 360/727] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:29:20.687132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b06c0f1a-d25a-40f3-8482-9569df69f5f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:20.688600 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b06c0f1a-d25a-40f3-8482-9569df69f5f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:20.694080 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-740f60a8-eb52-4853-ac96-d694f6b7b9ea tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:20.694861 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-740f60a8-eb52-4853-ac96-d694f6b7b9ea tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:20.695384 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b06c0f1a-d25a-40f3-8482-9569df69f5f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:20.695870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b06c0f1a-d25a-40f3-8482-9569df69f5f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:20.696302 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b06c0f1a-d25a-40f3-8482-9569df69f5f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:20.697075 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b06c0f1a-d25a-40f3-8482-9569df69f5f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:20.697539 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b06c0f1a-d25a-40f3-8482-9569df69f5f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:20.697963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b06c0f1a-d25a-40f3-8482-9569df69f5f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:20.701271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-740f60a8-eb52-4853-ac96-d694f6b7b9ea tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:20.701757 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-740f60a8-eb52-4853-ac96-d694f6b7b9ea tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:20.702187 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-740f60a8-eb52-4853-ac96-d694f6b7b9ea tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:20.702937 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-740f60a8-eb52-4853-ac96-d694f6b7b9ea tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:20.703398 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-740f60a8-eb52-4853-ac96-d694f6b7b9ea tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:20.703816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-740f60a8-eb52-4853-ac96-d694f6b7b9ea tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:20.904939 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b06c0f1a-d25a-40f3-8482-9569df69f5f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:20.913033 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b06c0f1a-d25a-40f3-8482-9569df69f5f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:20.914536 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b06c0f1a-d25a-40f3-8482-9569df69f5f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:20.915634 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b06c0f1a-d25a-40f3-8482-9569df69f5f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1406 microversion: 2.20 time: 0.232481 Aug 19 15:29:20.916188 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 368/728] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:29:20 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:29:20.920952 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-740f60a8-eb52-4853-ac96-d694f6b7b9ea tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:20.930107 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-740f60a8-eb52-4853-ac96-d694f6b7b9ea tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1758 microversion: 2.1 time: 0.240143 Aug 19 15:29:20.930760 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 361/729] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:20 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1758 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:21.054280 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6c35ba95-6b38-42c1-ae3d-5620a8517bf0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:21.054801 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6c35ba95-6b38-42c1-ae3d-5620a8517bf0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:21.060689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c35ba95-6b38-42c1-ae3d-5620a8517bf0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:21.061160 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c35ba95-6b38-42c1-ae3d-5620a8517bf0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:21.061585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c35ba95-6b38-42c1-ae3d-5620a8517bf0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:21.062259 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c35ba95-6b38-42c1-ae3d-5620a8517bf0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:21.062995 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c35ba95-6b38-42c1-ae3d-5620a8517bf0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:21.063371 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c35ba95-6b38-42c1-ae3d-5620a8517bf0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:21.198935 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6c35ba95-6b38-42c1-ae3d-5620a8517bf0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:21.206586 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6c35ba95-6b38-42c1-ae3d-5620a8517bf0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1266 microversion: 2.1 time: 0.156183 Aug 19 15:29:21.207152 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 369/730] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:21 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:21.940234 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9f9ee028-1c8f-4687-a0ea-b965a82c0adf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:21.940845 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9f9ee028-1c8f-4687-a0ea-b965a82c0adf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:21.947910 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f9ee028-1c8f-4687-a0ea-b965a82c0adf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:21.948383 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f9ee028-1c8f-4687-a0ea-b965a82c0adf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:21.948830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f9ee028-1c8f-4687-a0ea-b965a82c0adf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:21.949507 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f9ee028-1c8f-4687-a0ea-b965a82c0adf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:21.949950 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f9ee028-1c8f-4687-a0ea-b965a82c0adf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:21.950368 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f9ee028-1c8f-4687-a0ea-b965a82c0adf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:21.951370 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ce5c3054-7174-4df8-8e5a-9bb78e08717d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:21.952067 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ce5c3054-7174-4df8-8e5a-9bb78e08717d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:21.959222 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce5c3054-7174-4df8-8e5a-9bb78e08717d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:21.959704 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce5c3054-7174-4df8-8e5a-9bb78e08717d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:21.960130 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce5c3054-7174-4df8-8e5a-9bb78e08717d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:21.960848 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce5c3054-7174-4df8-8e5a-9bb78e08717d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:21.961298 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce5c3054-7174-4df8-8e5a-9bb78e08717d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:21.961720 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce5c3054-7174-4df8-8e5a-9bb78e08717d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:22.162748 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f9ee028-1c8f-4687-a0ea-b965a82c0adf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:22.168999 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ce5c3054-7174-4df8-8e5a-9bb78e08717d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:22.171648 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f9ee028-1c8f-4687-a0ea-b965a82c0adf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:22.174512 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f9ee028-1c8f-4687-a0ea-b965a82c0adf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:22.175793 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9f9ee028-1c8f-4687-a0ea-b965a82c0adf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1597 microversion: 2.20 time: 0.240909 Aug 19 15:29:22.176590 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 362/731] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:29:21 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1597 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:29:22.178497 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ce5c3054-7174-4df8-8e5a-9bb78e08717d tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1758 microversion: 2.1 time: 0.230994 Aug 19 15:29:22.179070 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 370/732] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:21 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1758 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:29:22.199496 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f8b2b1e9-4cb8-4008-907a-2044be0efe61 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:22.199912 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f8b2b1e9-4cb8-4008-907a-2044be0efe61 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:22.205865 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8b2b1e9-4cb8-4008-907a-2044be0efe61 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:22.206349 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8b2b1e9-4cb8-4008-907a-2044be0efe61 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:22.206779 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8b2b1e9-4cb8-4008-907a-2044be0efe61 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:22.207463 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8b2b1e9-4cb8-4008-907a-2044be0efe61 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:22.207911 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8b2b1e9-4cb8-4008-907a-2044be0efe61 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:22.208329 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8b2b1e9-4cb8-4008-907a-2044be0efe61 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:22.227092 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-57f11555-fc94-4ea2-8666-8c23c47d1a96 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:22.227713 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-57f11555-fc94-4ea2-8666-8c23c47d1a96 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:22.233813 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57f11555-fc94-4ea2-8666-8c23c47d1a96 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:22.235022 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57f11555-fc94-4ea2-8666-8c23c47d1a96 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:22.235710 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57f11555-fc94-4ea2-8666-8c23c47d1a96 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:22.236639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57f11555-fc94-4ea2-8666-8c23c47d1a96 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:22.237099 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57f11555-fc94-4ea2-8666-8c23c47d1a96 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:22.237524 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57f11555-fc94-4ea2-8666-8c23c47d1a96 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:22.323518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f8b2b1e9-4cb8-4008-907a-2044be0efe61 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.128045 Aug 19 15:29:22.325018 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 363/733] 10.222.0.75 () {60 vars in 1316 bytes} [Fri Aug 19 15:29:22 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 15:29:22.390286 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-57f11555-fc94-4ea2-8666-8c23c47d1a96 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:22.398986 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-57f11555-fc94-4ea2-8666-8c23c47d1a96 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1266 microversion: 2.1 time: 0.175843 Aug 19 15:29:22.399561 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 371/734] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:22 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:22.973025 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3437083b-87f7-477b-813b-bf9868d96c08 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:22.975280 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3437083b-87f7-477b-813b-bf9868d96c08 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:22.981305 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3437083b-87f7-477b-813b-bf9868d96c08 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:22.981886 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3437083b-87f7-477b-813b-bf9868d96c08 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:22.982316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3437083b-87f7-477b-813b-bf9868d96c08 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:22.982992 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3437083b-87f7-477b-813b-bf9868d96c08 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:22.983434 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3437083b-87f7-477b-813b-bf9868d96c08 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:22.983844 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3437083b-87f7-477b-813b-bf9868d96c08 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:23.014848 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3437083b-87f7-477b-813b-bf9868d96c08 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046661 Aug 19 15:29:23.015913 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 364/735] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:29:22 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:29:23.026034 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5a78131d-fd27-4167-b56e-f425946b3447 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:23.026606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5a78131d-fd27-4167-b56e-f425946b3447 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:23.033575 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a78131d-fd27-4167-b56e-f425946b3447 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:23.034128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a78131d-fd27-4167-b56e-f425946b3447 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:23.034626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a78131d-fd27-4167-b56e-f425946b3447 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:23.035380 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a78131d-fd27-4167-b56e-f425946b3447 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:23.035896 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a78131d-fd27-4167-b56e-f425946b3447 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:23.036418 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a78131d-fd27-4167-b56e-f425946b3447 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:23.067684 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5a78131d-fd27-4167-b56e-f425946b3447 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments/11a57969-cc6b-4a26-8aa9-a7777fd1e990" status: 200 len: 194 microversion: 2.1 time: 0.045535 Aug 19 15:29:23.068291 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 372/736] 10.222.0.75 () {58 vars in 1413 bytes} [Fri Aug 19 15:29:23 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments/11a57969-cc6b-4a26-8aa9-a7777fd1e990 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:29:23.200968 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-35c68289-aafc-4869-ba4e-e4bf0e5362e4 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:23.201707 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-35c68289-aafc-4869-ba4e-e4bf0e5362e4 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:23.208233 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35c68289-aafc-4869-ba4e-e4bf0e5362e4 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:23.208839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35c68289-aafc-4869-ba4e-e4bf0e5362e4 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:23.209349 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35c68289-aafc-4869-ba4e-e4bf0e5362e4 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:23.210232 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35c68289-aafc-4869-ba4e-e4bf0e5362e4 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:23.210749 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35c68289-aafc-4869-ba4e-e4bf0e5362e4 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:23.211395 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35c68289-aafc-4869-ba4e-e4bf0e5362e4 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:23.415074 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-35c68289-aafc-4869-ba4e-e4bf0e5362e4 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:23.420637 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5a22a1d3-6c93-44b9-ac00-623e74352f81 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:23.421746 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5a22a1d3-6c93-44b9-ac00-623e74352f81 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:23.424984 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-35c68289-aafc-4869-ba4e-e4bf0e5362e4 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1758 microversion: 2.1 time: 0.228082 Aug 19 15:29:23.425728 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 365/737] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:23 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1758 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:29:23.439196 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a22a1d3-6c93-44b9-ac00-623e74352f81 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:23.439196 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a22a1d3-6c93-44b9-ac00-623e74352f81 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:23.439196 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a22a1d3-6c93-44b9-ac00-623e74352f81 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:23.439196 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a22a1d3-6c93-44b9-ac00-623e74352f81 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:23.439607 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a22a1d3-6c93-44b9-ac00-623e74352f81 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:23.439607 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a22a1d3-6c93-44b9-ac00-623e74352f81 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:23.571780 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5a22a1d3-6c93-44b9-ac00-623e74352f81 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:23.573643 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-08e0ab59-acf7-4cda-8cbc-fbe3410e441e req-827a8174-1267-4585-9ea6-b57244052e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08b2c2fe-ead2-4d92-b4fb-dc42b41094fd", "tag": "5bf9b7d8-d705-4190-bd01-29213ebc351a"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:29:23.580783 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5a22a1d3-6c93-44b9-ac00-623e74352f81 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1266 microversion: 2.1 time: 0.164531 Aug 19 15:29:23.581355 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 373/738] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:23 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:29:23.583632 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-08e0ab59-acf7-4cda-8cbc-fbe3410e441e req-827a8174-1267-4585-9ea6-b57244052e9f service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:23.584371 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-08e0ab59-acf7-4cda-8cbc-fbe3410e441e req-827a8174-1267-4585-9ea6-b57244052e9f service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:23.585099 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-08e0ab59-acf7-4cda-8cbc-fbe3410e441e req-827a8174-1267-4585-9ea6-b57244052e9f service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:23.597761 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-08e0ab59-acf7-4cda-8cbc-fbe3410e441e req-827a8174-1267-4585-9ea6-b57244052e9f service nova] Creating event network-changed:5bf9b7d8-d705-4190-bd01-29213ebc351a for instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd on hv-cinder-83538 Aug 19 15:29:23.603072 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-08e0ab59-acf7-4cda-8cbc-fbe3410e441e req-827a8174-1267-4585-9ea6-b57244052e9f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033170 Aug 19 15:29:23.603983 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 366/739] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:29:24.447760 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c68a2a91-88cd-4431-bd40-472ca9f9d895 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:24.448553 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c68a2a91-88cd-4431-bd40-472ca9f9d895 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:24.449913 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-22756337-7c05-488c-97dd-6c5d5a0dfad9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d888b329-65c4-4a31-ac63-8869d0cd72a9"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:29:24.452312 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-22756337-7c05-488c-97dd-6c5d5a0dfad9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:24.458202 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c68a2a91-88cd-4431-bd40-472ca9f9d895 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:24.458880 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c68a2a91-88cd-4431-bd40-472ca9f9d895 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:24.459508 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c68a2a91-88cd-4431-bd40-472ca9f9d895 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:24.459638 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22756337-7c05-488c-97dd-6c5d5a0dfad9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:24.460128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22756337-7c05-488c-97dd-6c5d5a0dfad9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:24.460601 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22756337-7c05-488c-97dd-6c5d5a0dfad9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:24.460863 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c68a2a91-88cd-4431-bd40-472ca9f9d895 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:24.461291 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22756337-7c05-488c-97dd-6c5d5a0dfad9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:24.461660 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c68a2a91-88cd-4431-bd40-472ca9f9d895 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:24.461790 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22756337-7c05-488c-97dd-6c5d5a0dfad9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:24.462134 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22756337-7c05-488c-97dd-6c5d5a0dfad9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:24.462725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c68a2a91-88cd-4431-bd40-472ca9f9d895 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:24.617568 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:24.638922 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c68a2a91-88cd-4431-bd40-472ca9f9d895 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:24.653416 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c68a2a91-88cd-4431-bd40-472ca9f9d895 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1758 microversion: 2.1 time: 0.209918 Aug 19 15:29:24.655261 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 374/740] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:24 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1758 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:24.667241 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-fbc211fc-fbf2-4988-be1e-b06da820f1ec req-eb24a5a1-2b4b-4dde-ad77-94122b36cc33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a1ec3f-5819-42b2-8e3d-5d6327ba52f8", "name": "network-vif-plugged", "status": "completed", "tag": "cdfe8c13-bb9b-4403-9e35-60ecb60215b9"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:29:24.684938 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-fbc211fc-fbf2-4988-be1e-b06da820f1ec req-eb24a5a1-2b4b-4dde-ad77-94122b36cc33 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:24.685793 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-fbc211fc-fbf2-4988-be1e-b06da820f1ec req-eb24a5a1-2b4b-4dde-ad77-94122b36cc33 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:24.686301 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-fbc211fc-fbf2-4988-be1e-b06da820f1ec req-eb24a5a1-2b4b-4dde-ad77-94122b36cc33 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:24.699617 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-fbc211fc-fbf2-4988-be1e-b06da820f1ec req-eb24a5a1-2b4b-4dde-ad77-94122b36cc33 service nova] Creating event network-vif-plugged:cdfe8c13-bb9b-4403-9e35-60ecb60215b9 for instance 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 on hv-cinder-83538 Aug 19 15:29:24.706556 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-fbc211fc-fbf2-4988-be1e-b06da820f1ec req-eb24a5a1-2b4b-4dde-ad77-94122b36cc33 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049633 Aug 19 15:29:24.707909 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 375/741] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:29:24.713827 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-36bd28ca-c92e-4089-b8f6-b5b3aaaccb28 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:24.714525 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-36bd28ca-c92e-4089-b8f6-b5b3aaaccb28 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:24.722617 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36bd28ca-c92e-4089-b8f6-b5b3aaaccb28 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:24.723360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36bd28ca-c92e-4089-b8f6-b5b3aaaccb28 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:24.723800 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36bd28ca-c92e-4089-b8f6-b5b3aaaccb28 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:24.724534 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36bd28ca-c92e-4089-b8f6-b5b3aaaccb28 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:24.725144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36bd28ca-c92e-4089-b8f6-b5b3aaaccb28 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:24.725732 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36bd28ca-c92e-4089-b8f6-b5b3aaaccb28 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:24.770348 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-22756337-7c05-488c-97dd-6c5d5a0dfad9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "POST /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325033 Aug 19 15:29:24.771217 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 367/742] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Aug 19 15:29:24 2022] POST /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:29:24.892750 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-36bd28ca-c92e-4089-b8f6-b5b3aaaccb28 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:24.895050 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:24.902827 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-36bd28ca-c92e-4089-b8f6-b5b3aaaccb28 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1266 microversion: 2.1 time: 0.193387 Aug 19 15:29:24.903338 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 376/743] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:24 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:25.681320 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-faed1965-e78c-48ed-9f7c-0433da35fb59 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:25.682034 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-faed1965-e78c-48ed-9f7c-0433da35fb59 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:25.689425 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-faed1965-e78c-48ed-9f7c-0433da35fb59 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:25.689899 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-faed1965-e78c-48ed-9f7c-0433da35fb59 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:25.690325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-faed1965-e78c-48ed-9f7c-0433da35fb59 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:25.690997 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-faed1965-e78c-48ed-9f7c-0433da35fb59 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:25.691436 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-faed1965-e78c-48ed-9f7c-0433da35fb59 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:25.691845 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-faed1965-e78c-48ed-9f7c-0433da35fb59 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:25.836304 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-faed1965-e78c-48ed-9f7c-0433da35fb59 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:25.845203 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-faed1965-e78c-48ed-9f7c-0433da35fb59 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1758 microversion: 2.1 time: 0.168583 Aug 19 15:29:25.845933 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 368/744] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:25 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:25.926152 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-edc497d3-7fb4-4782-a959-ef7c2ac13a99 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:25.926684 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-edc497d3-7fb4-4782-a959-ef7c2ac13a99 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:25.933054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edc497d3-7fb4-4782-a959-ef7c2ac13a99 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:25.933528 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edc497d3-7fb4-4782-a959-ef7c2ac13a99 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:25.933955 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edc497d3-7fb4-4782-a959-ef7c2ac13a99 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:25.934627 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edc497d3-7fb4-4782-a959-ef7c2ac13a99 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:25.935068 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edc497d3-7fb4-4782-a959-ef7c2ac13a99 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:25.935482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edc497d3-7fb4-4782-a959-ef7c2ac13a99 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:26.289597 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-edc497d3-7fb4-4782-a959-ef7c2ac13a99 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:26.298149 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-edc497d3-7fb4-4782-a959-ef7c2ac13a99 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1266 microversion: 2.1 time: 0.377287 Aug 19 15:29:26.298746 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 377/745] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:25 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1266 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:26.866299 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-150d853c-ae8f-472d-a1b1-86081f928d94 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:26.866907 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-150d853c-ae8f-472d-a1b1-86081f928d94 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:26.873269 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-150d853c-ae8f-472d-a1b1-86081f928d94 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:26.873739 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-150d853c-ae8f-472d-a1b1-86081f928d94 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:26.874161 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-150d853c-ae8f-472d-a1b1-86081f928d94 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:26.875509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-150d853c-ae8f-472d-a1b1-86081f928d94 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:26.875977 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-150d853c-ae8f-472d-a1b1-86081f928d94 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:26.876415 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-150d853c-ae8f-472d-a1b1-86081f928d94 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:27.019792 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-150d853c-ae8f-472d-a1b1-86081f928d94 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:27.027847 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-150d853c-ae8f-472d-a1b1-86081f928d94 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1758 microversion: 2.1 time: 0.165410 Aug 19 15:29:27.028438 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 369/746] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:26 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:27.318872 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fde1ecf4-0401-4ad6-867c-45ed9c849ffd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:27.319475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fde1ecf4-0401-4ad6-867c-45ed9c849ffd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:27.325973 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fde1ecf4-0401-4ad6-867c-45ed9c849ffd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:27.326454 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fde1ecf4-0401-4ad6-867c-45ed9c849ffd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:27.326885 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fde1ecf4-0401-4ad6-867c-45ed9c849ffd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:27.327567 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fde1ecf4-0401-4ad6-867c-45ed9c849ffd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:27.328637 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fde1ecf4-0401-4ad6-867c-45ed9c849ffd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:27.329084 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fde1ecf4-0401-4ad6-867c-45ed9c849ffd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:27.457493 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fde1ecf4-0401-4ad6-867c-45ed9c849ffd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:27.465283 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fde1ecf4-0401-4ad6-867c-45ed9c849ffd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1453 microversion: 2.1 time: 0.150238 Aug 19 15:29:27.465840 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 378/747] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:27 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:27.485804 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a85a3456-838f-4be9-8410-8e0e729e2e65 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:27.486405 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a85a3456-838f-4be9-8410-8e0e729e2e65 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:27.492772 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a85a3456-838f-4be9-8410-8e0e729e2e65 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:27.493254 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a85a3456-838f-4be9-8410-8e0e729e2e65 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:27.493687 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a85a3456-838f-4be9-8410-8e0e729e2e65 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:27.494380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a85a3456-838f-4be9-8410-8e0e729e2e65 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:27.494829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a85a3456-838f-4be9-8410-8e0e729e2e65 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:27.495254 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a85a3456-838f-4be9-8410-8e0e729e2e65 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:27.626115 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a85a3456-838f-4be9-8410-8e0e729e2e65 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:27.633836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a85a3456-838f-4be9-8410-8e0e729e2e65 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1453 microversion: 2.1 time: 0.151990 Aug 19 15:29:27.634438 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 370/748] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:27 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:28.050068 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4b83766f-7294-4223-a9f0-be17b02247eb tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:28.050709 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4b83766f-7294-4223-a9f0-be17b02247eb tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:28.056778 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b83766f-7294-4223-a9f0-be17b02247eb tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:28.057264 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b83766f-7294-4223-a9f0-be17b02247eb tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:28.057693 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b83766f-7294-4223-a9f0-be17b02247eb tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:28.058385 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b83766f-7294-4223-a9f0-be17b02247eb tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:28.058839 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b83766f-7294-4223-a9f0-be17b02247eb tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:28.059256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b83766f-7294-4223-a9f0-be17b02247eb tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:28.305279 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4b83766f-7294-4223-a9f0-be17b02247eb tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:28.314471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4b83766f-7294-4223-a9f0-be17b02247eb tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1758 microversion: 2.1 time: 0.269651 Aug 19 15:29:28.315053 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 379/749] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:28 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1758 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:29.304419 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-a8d15abf-fddf-4ace-ac41-41ecb273f401 req-53b6b373-3529-4bcf-88d1-7e6fe73ed6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a1ec3f-5819-42b2-8e3d-5d6327ba52f8", "tag": "cdfe8c13-bb9b-4403-9e35-60ecb60215b9"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:29:29.315730 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-a8d15abf-fddf-4ace-ac41-41ecb273f401 req-53b6b373-3529-4bcf-88d1-7e6fe73ed6a6 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:29.316297 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-a8d15abf-fddf-4ace-ac41-41ecb273f401 req-53b6b373-3529-4bcf-88d1-7e6fe73ed6a6 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:29.316760 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-a8d15abf-fddf-4ace-ac41-41ecb273f401 req-53b6b373-3529-4bcf-88d1-7e6fe73ed6a6 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:29.328603 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-a8d15abf-fddf-4ace-ac41-41ecb273f401 req-53b6b373-3529-4bcf-88d1-7e6fe73ed6a6 service nova] Creating event network-changed:cdfe8c13-bb9b-4403-9e35-60ecb60215b9 for instance 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 on hv-cinder-83538 Aug 19 15:29:29.333586 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-a8d15abf-fddf-4ace-ac41-41ecb273f401 req-53b6b373-3529-4bcf-88d1-7e6fe73ed6a6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032929 Aug 19 15:29:29.334316 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 371/750] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:29:29.335298 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0b4b6a81-dcf4-4a30-9706-b1420dc944d8 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:29.336012 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0b4b6a81-dcf4-4a30-9706-b1420dc944d8 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:29.353564 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b4b6a81-dcf4-4a30-9706-b1420dc944d8 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:29.354054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b4b6a81-dcf4-4a30-9706-b1420dc944d8 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:29.354497 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b4b6a81-dcf4-4a30-9706-b1420dc944d8 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:29.355298 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b4b6a81-dcf4-4a30-9706-b1420dc944d8 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:29.355754 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b4b6a81-dcf4-4a30-9706-b1420dc944d8 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:29.356180 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b4b6a81-dcf4-4a30-9706-b1420dc944d8 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:29.513160 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0b4b6a81-dcf4-4a30-9706-b1420dc944d8 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:29.522469 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0b4b6a81-dcf4-4a30-9706-b1420dc944d8 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1758 microversion: 2.1 time: 0.191154 Aug 19 15:29:29.523163 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 380/751] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:29 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:29:30.544506 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f3c1441a-aa1e-4d5b-b749-d7b89c93ce3e tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:30.545208 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f3c1441a-aa1e-4d5b-b749-d7b89c93ce3e tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:30.552203 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3c1441a-aa1e-4d5b-b749-d7b89c93ce3e tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:30.552714 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3c1441a-aa1e-4d5b-b749-d7b89c93ce3e tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:30.553143 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3c1441a-aa1e-4d5b-b749-d7b89c93ce3e tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:30.553820 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3c1441a-aa1e-4d5b-b749-d7b89c93ce3e tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:30.554267 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3c1441a-aa1e-4d5b-b749-d7b89c93ce3e tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:30.554684 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3c1441a-aa1e-4d5b-b749-d7b89c93ce3e tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:30.698137 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f3c1441a-aa1e-4d5b-b749-d7b89c93ce3e tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:30.706491 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f3c1441a-aa1e-4d5b-b749-d7b89c93ce3e tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1758 microversion: 2.1 time: 0.166682 Aug 19 15:29:30.707057 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 372/752] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:30 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:31.728027 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1b059dd2-f291-49d8-afb8-97af719ae6cf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:31.728677 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1b059dd2-f291-49d8-afb8-97af719ae6cf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:31.735284 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b059dd2-f291-49d8-afb8-97af719ae6cf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:31.735763 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b059dd2-f291-49d8-afb8-97af719ae6cf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:31.736199 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b059dd2-f291-49d8-afb8-97af719ae6cf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:31.736934 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b059dd2-f291-49d8-afb8-97af719ae6cf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:31.737391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b059dd2-f291-49d8-afb8-97af719ae6cf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:31.737815 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b059dd2-f291-49d8-afb8-97af719ae6cf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:31.889579 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1b059dd2-f291-49d8-afb8-97af719ae6cf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:31.898799 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1b059dd2-f291-49d8-afb8-97af719ae6cf tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1758 microversion: 2.1 time: 0.175358 Aug 19 15:29:31.899366 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 381/753] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:31 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:32.304872 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ba212a71-8afb-497e-8eea-019df27f3677 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:32.307101 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ba212a71-8afb-497e-8eea-019df27f3677 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:32.313618 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba212a71-8afb-497e-8eea-019df27f3677 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:32.314096 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba212a71-8afb-497e-8eea-019df27f3677 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:32.314529 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba212a71-8afb-497e-8eea-019df27f3677 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:32.315204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba212a71-8afb-497e-8eea-019df27f3677 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:32.315648 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba212a71-8afb-497e-8eea-019df27f3677 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:32.316068 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba212a71-8afb-497e-8eea-019df27f3677 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:32.345293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ba212a71-8afb-497e-8eea-019df27f3677 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044344 Aug 19 15:29:32.345850 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 373/754] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:29:32 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:29:32.489319 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cf2c3742-ed13-406f-bd5d-56359baadbd7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:32.489715 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cf2c3742-ed13-406f-bd5d-56359baadbd7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:32.495611 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf2c3742-ed13-406f-bd5d-56359baadbd7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:32.496085 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf2c3742-ed13-406f-bd5d-56359baadbd7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:32.496535 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf2c3742-ed13-406f-bd5d-56359baadbd7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:32.497209 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf2c3742-ed13-406f-bd5d-56359baadbd7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:32.497651 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf2c3742-ed13-406f-bd5d-56359baadbd7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:32.498061 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf2c3742-ed13-406f-bd5d-56359baadbd7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:32.526360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cf2c3742-ed13-406f-bd5d-56359baadbd7 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments/11a57969-cc6b-4a26-8aa9-a7777fd1e990" status: 200 len: 194 microversion: 2.1 time: 0.041777 Aug 19 15:29:32.526943 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 382/755] 10.222.0.75 () {58 vars in 1413 bytes} [Fri Aug 19 15:29:32 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments/11a57969-cc6b-4a26-8aa9-a7777fd1e990 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:29:32.537941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ea1189c9-b215-430f-8b36-d739d737f060 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:32.538433 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ea1189c9-b215-430f-8b36-d739d737f060 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:32.544479 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea1189c9-b215-430f-8b36-d739d737f060 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:32.544968 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea1189c9-b215-430f-8b36-d739d737f060 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:32.545401 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea1189c9-b215-430f-8b36-d739d737f060 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:32.546092 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea1189c9-b215-430f-8b36-d739d737f060 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:32.546575 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea1189c9-b215-430f-8b36-d739d737f060 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:32.547867 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea1189c9-b215-430f-8b36-d739d737f060 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:32.630060 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-ea1189c9-b215-430f-8b36-d739d737f060 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lazy-loading 'services' on Instance uuid 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:29:32.703546 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ea1189c9-b215-430f-8b36-d739d737f060 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "DELETE /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments/11a57969-cc6b-4a26-8aa9-a7777fd1e990" status: 202 len: 0 microversion: 2.1 time: 0.168921 Aug 19 15:29:32.704252 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 374/756] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Aug 19 15:29:32 2022] DELETE /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments/11a57969-cc6b-4a26-8aa9-a7777fd1e990 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:29:32.920081 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f039b33f-0d95-4068-a356-42d5573a4715 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:32.920726 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f039b33f-0d95-4068-a356-42d5573a4715 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:32.927442 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f039b33f-0d95-4068-a356-42d5573a4715 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:32.927922 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f039b33f-0d95-4068-a356-42d5573a4715 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:32.928355 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f039b33f-0d95-4068-a356-42d5573a4715 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:32.929069 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f039b33f-0d95-4068-a356-42d5573a4715 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:32.929520 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f039b33f-0d95-4068-a356-42d5573a4715 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:32.929946 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f039b33f-0d95-4068-a356-42d5573a4715 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:33.070472 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f039b33f-0d95-4068-a356-42d5573a4715 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:33.079461 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f039b33f-0d95-4068-a356-42d5573a4715 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1761 microversion: 2.1 time: 0.163226 Aug 19 15:29:33.080018 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 383/757] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:32 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1761 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:34.881328 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-766173e1-73a7-477f-a51d-5aa3d6f2dff5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:34.881936 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-766173e1-73a7-477f-a51d-5aa3d6f2dff5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:34.888048 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-766173e1-73a7-477f-a51d-5aa3d6f2dff5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:34.888577 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-766173e1-73a7-477f-a51d-5aa3d6f2dff5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:34.889022 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-766173e1-73a7-477f-a51d-5aa3d6f2dff5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:34.889693 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-766173e1-73a7-477f-a51d-5aa3d6f2dff5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:34.890146 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-766173e1-73a7-477f-a51d-5aa3d6f2dff5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:34.891114 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-766173e1-73a7-477f-a51d-5aa3d6f2dff5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:34.919831 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-766173e1-73a7-477f-a51d-5aa3d6f2dff5 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments/d888b329-65c4-4a31-ac63-8869d0cd72a9" status: 200 len: 194 microversion: 2.1 time: 0.043417 Aug 19 15:29:34.920432 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 375/758] 10.222.0.75 () {58 vars in 1413 bytes} [Fri Aug 19 15:29:34 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments/d888b329-65c4-4a31-ac63-8869d0cd72a9 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:29:34.931256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3ced436-f6a7-4f96-9bc5-44d021bff541 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:34.931755 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b3ced436-f6a7-4f96-9bc5-44d021bff541 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:34.938170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3ced436-f6a7-4f96-9bc5-44d021bff541 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:34.938646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3ced436-f6a7-4f96-9bc5-44d021bff541 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:34.939076 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3ced436-f6a7-4f96-9bc5-44d021bff541 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:34.939759 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3ced436-f6a7-4f96-9bc5-44d021bff541 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:34.940210 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3ced436-f6a7-4f96-9bc5-44d021bff541 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:34.940663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3ced436-f6a7-4f96-9bc5-44d021bff541 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:35.021684 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-b3ced436-f6a7-4f96-9bc5-44d021bff541 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lazy-loading 'services' on Instance uuid 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:29:35.092944 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b3ced436-f6a7-4f96-9bc5-44d021bff541 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "DELETE /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments/d888b329-65c4-4a31-ac63-8869d0cd72a9" status: 202 len: 0 microversion: 2.1 time: 0.165483 Aug 19 15:29:35.093591 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 384/759] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Aug 19 15:29:34 2022] DELETE /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments/d888b329-65c4-4a31-ac63-8869d0cd72a9 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:29:36.269320 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3b59de2d-d93a-4bff-b96b-1ab718b79a19 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:36.271518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3b59de2d-d93a-4bff-b96b-1ab718b79a19 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:36.277956 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b59de2d-d93a-4bff-b96b-1ab718b79a19 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:36.278499 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b59de2d-d93a-4bff-b96b-1ab718b79a19 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:36.278923 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b59de2d-d93a-4bff-b96b-1ab718b79a19 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:36.279592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b59de2d-d93a-4bff-b96b-1ab718b79a19 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:36.280031 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b59de2d-d93a-4bff-b96b-1ab718b79a19 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:36.280470 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b59de2d-d93a-4bff-b96b-1ab718b79a19 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:36.311178 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3b59de2d-d93a-4bff-b96b-1ab718b79a19 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045749 Aug 19 15:29:36.311739 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 376/760] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:29:36 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 15:29:36.427432 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-88d0abde-7f6e-4a6a-bff8-773855bb7ef2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:36.429739 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-88d0abde-7f6e-4a6a-bff8-773855bb7ef2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:36.436301 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88d0abde-7f6e-4a6a-bff8-773855bb7ef2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:36.436822 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88d0abde-7f6e-4a6a-bff8-773855bb7ef2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:36.437265 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88d0abde-7f6e-4a6a-bff8-773855bb7ef2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:36.438022 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88d0abde-7f6e-4a6a-bff8-773855bb7ef2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:36.438464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88d0abde-7f6e-4a6a-bff8-773855bb7ef2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:36.438879 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88d0abde-7f6e-4a6a-bff8-773855bb7ef2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:36.467700 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-88d0abde-7f6e-4a6a-bff8-773855bb7ef2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044973 Aug 19 15:29:36.468333 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 385/761] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:29:36 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 15:29:36.529637 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c9bb8b53-18c1-43eb-905d-07504ea00c32 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:36.530134 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c9bb8b53-18c1-43eb-905d-07504ea00c32 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:36.536707 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9bb8b53-18c1-43eb-905d-07504ea00c32 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:36.537193 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9bb8b53-18c1-43eb-905d-07504ea00c32 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:36.537628 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9bb8b53-18c1-43eb-905d-07504ea00c32 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:36.538319 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9bb8b53-18c1-43eb-905d-07504ea00c32 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:36.538771 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9bb8b53-18c1-43eb-905d-07504ea00c32 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:36.539196 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9bb8b53-18c1-43eb-905d-07504ea00c32 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:36.563227 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c9bb8b53-18c1-43eb-905d-07504ea00c32 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:29:36.637409 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c9bb8b53-18c1-43eb-905d-07504ea00c32 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "DELETE /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 204 len: 0 microversion: 2.1 time: 0.111326 Aug 19 15:29:36.638037 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 377/762] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:29:36 2022] DELETE /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:29:36.647128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-637f6777-f7f1-4508-8731-b42d3bfd8338 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:36.647734 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-637f6777-f7f1-4508-8731-b42d3bfd8338 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:36.653767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-637f6777-f7f1-4508-8731-b42d3bfd8338 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:36.654303 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-637f6777-f7f1-4508-8731-b42d3bfd8338 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:36.654742 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-637f6777-f7f1-4508-8731-b42d3bfd8338 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:36.655428 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-637f6777-f7f1-4508-8731-b42d3bfd8338 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:36.655884 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-637f6777-f7f1-4508-8731-b42d3bfd8338 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:36.656895 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-637f6777-f7f1-4508-8731-b42d3bfd8338 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:36.788618 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-637f6777-f7f1-4508-8731-b42d3bfd8338 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:36.796543 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-637f6777-f7f1-4508-8731-b42d3bfd8338 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1674 microversion: 2.1 time: 0.153285 Aug 19 15:29:36.797456 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 386/763] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:36 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:37.819371 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c3aaa79d-3f50-4cbd-9710-ff326bbe3822 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:37.820181 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c3aaa79d-3f50-4cbd-9710-ff326bbe3822 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:37.826600 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3aaa79d-3f50-4cbd-9710-ff326bbe3822 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:37.827080 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3aaa79d-3f50-4cbd-9710-ff326bbe3822 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:37.827507 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3aaa79d-3f50-4cbd-9710-ff326bbe3822 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:37.828865 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3aaa79d-3f50-4cbd-9710-ff326bbe3822 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:37.829321 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3aaa79d-3f50-4cbd-9710-ff326bbe3822 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:37.829742 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3aaa79d-3f50-4cbd-9710-ff326bbe3822 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:37.967907 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c3aaa79d-3f50-4cbd-9710-ff326bbe3822 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:37.976546 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c3aaa79d-3f50-4cbd-9710-ff326bbe3822 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1674 microversion: 2.1 time: 0.161420 Aug 19 15:29:37.977112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 378/764] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:37 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:38.997628 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b17a7b48-0392-4229-898e-eff00f22841f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:38.998378 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b17a7b48-0392-4229-898e-eff00f22841f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:39.005367 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b17a7b48-0392-4229-898e-eff00f22841f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:39.005849 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b17a7b48-0392-4229-898e-eff00f22841f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:39.006272 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b17a7b48-0392-4229-898e-eff00f22841f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:39.006957 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b17a7b48-0392-4229-898e-eff00f22841f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:39.007402 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b17a7b48-0392-4229-898e-eff00f22841f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:39.007851 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b17a7b48-0392-4229-898e-eff00f22841f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:39.138575 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b17a7b48-0392-4229-898e-eff00f22841f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc2bbdceb12641e6a0595e68f7cefd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ede055158e24b7c9a935b833e33b89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:29:39.146480 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b17a7b48-0392-4229-898e-eff00f22841f tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 200 len: 1674 microversion: 2.1 time: 0.152742 Aug 19 15:29:39.147147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 387/765] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:38 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:29:39.589426 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-c8a38eee-5488-47de-90f3-7cb52efbdd68 req-54ab054c-f782-427c-bb9c-240126fd9103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b74c1b-5e8f-463a-9b8d-f500e8a70ca6", "name": "network-vif-deleted", "tag": "a5f5d004-834d-4100-8eed-8e19902d8987"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:29:39.600435 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c8a38eee-5488-47de-90f3-7cb52efbdd68 req-54ab054c-f782-427c-bb9c-240126fd9103 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:39.600840 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c8a38eee-5488-47de-90f3-7cb52efbdd68 req-54ab054c-f782-427c-bb9c-240126fd9103 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:39.601262 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c8a38eee-5488-47de-90f3-7cb52efbdd68 req-54ab054c-f782-427c-bb9c-240126fd9103 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:39.613693 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-c8a38eee-5488-47de-90f3-7cb52efbdd68 req-54ab054c-f782-427c-bb9c-240126fd9103 service nova] Creating event network-vif-deleted:a5f5d004-834d-4100-8eed-8e19902d8987 for instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 on hv-cinder-83538 Aug 19 15:29:39.618808 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-c8a38eee-5488-47de-90f3-7cb52efbdd68 req-54ab054c-f782-427c-bb9c-240126fd9103 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033151 Aug 19 15:29:39.619772 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 379/766] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:29:40.168906 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5bd0a604-e433-42cc-b7f1-7e18e6319415 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:40.169484 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5bd0a604-e433-42cc-b7f1-7e18e6319415 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:40.177579 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bd0a604-e433-42cc-b7f1-7e18e6319415 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:40.178070 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bd0a604-e433-42cc-b7f1-7e18e6319415 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:40.178496 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bd0a604-e433-42cc-b7f1-7e18e6319415 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:40.179195 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bd0a604-e433-42cc-b7f1-7e18e6319415 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:40.179640 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bd0a604-e433-42cc-b7f1-7e18e6319415 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:40.180056 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bd0a604-e433-42cc-b7f1-7e18e6319415 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:40.195362 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-5bd0a604-e433-42cc-b7f1-7e18e6319415 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] HTTP exception thrown: Instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 could not be found. Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5bd0a604-e433-42cc-b7f1-7e18e6319415 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Request method failure captured: Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 HTTP/1.1 Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6rgteu55BhEMXr07OZCBOE44QcyuSzZTeJBt8qZaIsufjVVkhXgCgF6ZnBN0ca8ot6FhrE0fpF7ptahmZHtMWFSXJfCnb4K9DP9dKGaDlDrh1wv5jXTRWoVRkxkPuOSqnHFbuwHUJwXkgd8-gt6_KNOgegj75abwvvr95XCIigXC-c Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: 8ede055158e24b7c9a935b833e33b89a Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeTestJSON-361413854 Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:29:40.197054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:29:40.198670 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8ede055158e24b7c9a935b833e33b89a", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8ede055158e24b7c9a935b833e33b89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8ede055158e24b7c9a935b833e33b89a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8ede055158e24b7c9a935b833e33b89a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:29:40.198670 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeTestJSON-361413854 Aug 19 15:29:40.198670 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 8ede055158e24b7c9a935b833e33b89a Aug 19 15:29:40.198670 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361413854 Aug 19 15:29:40.198670 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeTestJSON-361413854-project Aug 19 15:29:40.198670 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:29:40.198670 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:29:40.198670 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: dc2bbdceb12641e6a0595e68f7cefd63 Aug 19 15:29:40.198670 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeTestJSON-361413854-project Aug 19 15:29:40.198670 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:29:40.198670 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 could not be found. Aug 19 15:29:40.198670 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': '69b74c1b-5e8f-463a-9b8d-f500e8a70ca6'} Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 could not be found. Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:29:40.199845 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:29:40.201263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:29:40.201263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:29:40.201263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:29:40.201263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:29:40.201263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:29:40.201263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:29:40.201263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:29:40.201263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 could not be found. Aug 19 15:29:40.201263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:40.201263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:29:40.201263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:40.201263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:29:40.201263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:29:40.201263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:29:40.201263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:29:40.201263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:29:40.201263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 could not be found. Aug 19 15:29:40.201263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:40.202853 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5bd0a604-e433-42cc-b7f1-7e18e6319415 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Returning 404 to user: Instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:29:40.202853 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5bd0a604-e433-42cc-b7f1-7e18e6319415 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 404 len: 111 microversion: 2.1 time: 0.033801 Aug 19 15:29:40.202853 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 388/767] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:40 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:29:40.208753 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-200b3c05-ad3e-4213-8310-292b4be25c85 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '.version_select at 0x7fb5331afaf0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:40.228073 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-200b3c05-ad3e-4213-8310-292b4be25c85 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419104470" status: 202 len: 0 microversion: 2.1 time: 0.023527 Aug 19 15:29:40.228800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 380/768] 10.222.0.75 () {58 vars in 1221 bytes} [Fri Aug 19 15:29:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419104470 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:29:43.132663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-33eb0d7b-286c-4717-b524-e9545e9964a9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:43.133156 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-33eb0d7b-286c-4717-b524-e9545e9964a9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:43.135784 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=70 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:43.142169 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33eb0d7b-286c-4717-b524-e9545e9964a9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:43.142644 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33eb0d7b-286c-4717-b524-e9545e9964a9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:43.143075 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33eb0d7b-286c-4717-b524-e9545e9964a9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:43.143756 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33eb0d7b-286c-4717-b524-e9545e9964a9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:43.144199 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33eb0d7b-286c-4717-b524-e9545e9964a9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:43.144651 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33eb0d7b-286c-4717-b524-e9545e9964a9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:43.158944 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-33eb0d7b-286c-4717-b524-e9545e9964a9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] HTTP exception thrown: Instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 could not be found. Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-33eb0d7b-286c-4717-b524-e9545e9964a9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Request method failure captured: Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 HTTP/1.1 Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6rgteu55BhEMXr07OZCBOE44QcyuSzZTeJBt8qZaIsufjVVkhXgCgF6ZnBN0ca8ot6FhrE0fpF7ptahmZHtMWFSXJfCnb4K9DP9dKGaDlDrh1wv5jXTRWoVRkxkPuOSqnHFbuwHUJwXkgd8-gt6_KNOgegj75abwvvr95XCIigXC-c Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: 8ede055158e24b7c9a935b833e33b89a Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeTestJSON-361413854 Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:29:43.160471 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:29:43.161993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8ede055158e24b7c9a935b833e33b89a", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8ede055158e24b7c9a935b833e33b89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8ede055158e24b7c9a935b833e33b89a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8ede055158e24b7c9a935b833e33b89a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:29:43.161993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeTestJSON-361413854 Aug 19 15:29:43.161993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 8ede055158e24b7c9a935b833e33b89a Aug 19 15:29:43.161993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361413854 Aug 19 15:29:43.161993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeTestJSON-361413854-project Aug 19 15:29:43.161993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:29:43.161993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:29:43.161993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: dc2bbdceb12641e6a0595e68f7cefd63 Aug 19 15:29:43.161993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeTestJSON-361413854-project Aug 19 15:29:43.161993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:29:43.161993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 could not be found. Aug 19 15:29:43.161993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': '69b74c1b-5e8f-463a-9b8d-f500e8a70ca6'} Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 could not be found. Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:29:43.162876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 could not be found. Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 could not be found. Aug 19 15:29:43.164434 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:43.165998 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-33eb0d7b-286c-4717-b524-e9545e9964a9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Returning 404 to user: Instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:29:43.165998 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-33eb0d7b-286c-4717-b524-e9545e9964a9 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "DELETE /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 404 len: 111 microversion: 2.1 time: 0.032948 Aug 19 15:29:43.165998 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 389/769] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:29:43 2022] DELETE /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:29:43.170136 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-98cfced5-3a5d-4277-8cb6-aa4f17d22731 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:43.170872 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-98cfced5-3a5d-4277-8cb6-aa4f17d22731 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:43.177882 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98cfced5-3a5d-4277-8cb6-aa4f17d22731 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:43.178361 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98cfced5-3a5d-4277-8cb6-aa4f17d22731 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:43.178793 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98cfced5-3a5d-4277-8cb6-aa4f17d22731 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:43.179476 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98cfced5-3a5d-4277-8cb6-aa4f17d22731 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:43.179932 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98cfced5-3a5d-4277-8cb6-aa4f17d22731 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:43.180355 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98cfced5-3a5d-4277-8cb6-aa4f17d22731 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:43.193469 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-98cfced5-3a5d-4277-8cb6-aa4f17d22731 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] HTTP exception thrown: Instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 could not be found. Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-98cfced5-3a5d-4277-8cb6-aa4f17d22731 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Request method failure captured: Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 HTTP/1.1 Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6rgteu55BhEMXr07OZCBOE44QcyuSzZTeJBt8qZaIsufjVVkhXgCgF6ZnBN0ca8ot6FhrE0fpF7ptahmZHtMWFSXJfCnb4K9DP9dKGaDlDrh1wv5jXTRWoVRkxkPuOSqnHFbuwHUJwXkgd8-gt6_KNOgegj75abwvvr95XCIigXC-c Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: 8ede055158e24b7c9a935b833e33b89a Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeTestJSON-361413854 Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:29:43.195063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:29:43.196719 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8ede055158e24b7c9a935b833e33b89a", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8ede055158e24b7c9a935b833e33b89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8ede055158e24b7c9a935b833e33b89a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8ede055158e24b7c9a935b833e33b89a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:29:43.196719 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeTestJSON-361413854 Aug 19 15:29:43.196719 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 8ede055158e24b7c9a935b833e33b89a Aug 19 15:29:43.196719 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361413854 Aug 19 15:29:43.196719 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeTestJSON-361413854-project Aug 19 15:29:43.196719 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:29:43.196719 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:29:43.196719 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: dc2bbdceb12641e6a0595e68f7cefd63 Aug 19 15:29:43.196719 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeTestJSON-361413854-project Aug 19 15:29:43.196719 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:29:43.196719 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 could not be found. Aug 19 15:29:43.196719 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': '69b74c1b-5e8f-463a-9b8d-f500e8a70ca6'} Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 could not be found. Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:29:43.197581 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:29:43.199013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:29:43.199013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:29:43.199013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:29:43.199013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:29:43.199013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:29:43.199013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:29:43.199013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:29:43.199013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 could not be found. Aug 19 15:29:43.199013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:29:43.199013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:29:43.199013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:29:43.199013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:29:43.199013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:29:43.199013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:29:43.199013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:29:43.199013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:29:43.199013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 could not be found. Aug 19 15:29:43.199013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:29:43.200305 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-98cfced5-3a5d-4277-8cb6-aa4f17d22731 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Returning 404 to user: Instance 69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:29:43.200305 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-98cfced5-3a5d-4277-8cb6-aa4f17d22731 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6" status: 404 len: 111 microversion: 2.1 time: 0.030143 Aug 19 15:29:43.200305 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 381/770] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:43 2022] GET /compute/v2.1/servers/69b74c1b-5e8f-463a-9b8d-f500e8a70ca6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:29:44.336126 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b44d63c8-db34-4d80-ae3f-968bfa6ee25c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:44.336649 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b44d63c8-db34-4d80-ae3f-968bfa6ee25c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:44.342931 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b44d63c8-db34-4d80-ae3f-968bfa6ee25c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:44.343403 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b44d63c8-db34-4d80-ae3f-968bfa6ee25c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:44.344584 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b44d63c8-db34-4d80-ae3f-968bfa6ee25c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:44.345190 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b44d63c8-db34-4d80-ae3f-968bfa6ee25c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:44.345718 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b44d63c8-db34-4d80-ae3f-968bfa6ee25c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:44.346142 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b44d63c8-db34-4d80-ae3f-968bfa6ee25c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:44.359044 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-b44d63c8-db34-4d80-ae3f-968bfa6ee25c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] HTTP exception thrown: Instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d could not be found. Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b44d63c8-db34-4d80-ae3f-968bfa6ee25c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Request method failure captured: Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d HTTP/1.1 Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6rgteu55BhEMXr07OZCBOE44QcyuSzZTeJBt8qZaIsufjVVkhXgCgF6ZnBN0ca8ot6FhrE0fpF7ptahmZHtMWFSXJfCnb4K9DP9dKGaDlDrh1wv5jXTRWoVRkxkPuOSqnHFbuwHUJwXkgd8-gt6_KNOgegj75abwvvr95XCIigXC-c Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: 8ede055158e24b7c9a935b833e33b89a Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeTestJSON-361413854 Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:29:44.361360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:29:44.362988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8ede055158e24b7c9a935b833e33b89a", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8ede055158e24b7c9a935b833e33b89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8ede055158e24b7c9a935b833e33b89a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8ede055158e24b7c9a935b833e33b89a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:29:44.362988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeTestJSON-361413854 Aug 19 15:29:44.362988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 8ede055158e24b7c9a935b833e33b89a Aug 19 15:29:44.362988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361413854 Aug 19 15:29:44.362988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeTestJSON-361413854-project Aug 19 15:29:44.362988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:29:44.362988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:29:44.362988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: dc2bbdceb12641e6a0595e68f7cefd63 Aug 19 15:29:44.362988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeTestJSON-361413854-project Aug 19 15:29:44.362988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:29:44.362988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d could not be found. Aug 19 15:29:44.362988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': 'f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d'} Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d could not be found. Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:29:44.363860 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d could not be found. Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d could not be found. Aug 19 15:29:44.365587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:29:44.367198 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b44d63c8-db34-4d80-ae3f-968bfa6ee25c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Returning 404 to user: Instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:29:44.367198 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b44d63c8-db34-4d80-ae3f-968bfa6ee25c tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 404 len: 111 microversion: 2.1 time: 0.030366 Aug 19 15:29:44.367198 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 390/771] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:29:44 2022] DELETE /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:29:44.371198 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b092b57e-a23d-4382-9ff6-39b8f7e90aa2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:44.371804 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b092b57e-a23d-4382-9ff6-39b8f7e90aa2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] [instance: f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:44.374209 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:44.381744 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b092b57e-a23d-4382-9ff6-39b8f7e90aa2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:44.382224 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b092b57e-a23d-4382-9ff6-39b8f7e90aa2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:44.382656 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b092b57e-a23d-4382-9ff6-39b8f7e90aa2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:44.383341 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b092b57e-a23d-4382-9ff6-39b8f7e90aa2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:44.383790 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b092b57e-a23d-4382-9ff6-39b8f7e90aa2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:44.384212 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b092b57e-a23d-4382-9ff6-39b8f7e90aa2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:44.398672 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-b092b57e-a23d-4382-9ff6-39b8f7e90aa2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] HTTP exception thrown: Instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d could not be found. Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b092b57e-a23d-4382-9ff6-39b8f7e90aa2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Request method failure captured: Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d HTTP/1.1 Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6rgteu55BhEMXr07OZCBOE44QcyuSzZTeJBt8qZaIsufjVVkhXgCgF6ZnBN0ca8ot6FhrE0fpF7ptahmZHtMWFSXJfCnb4K9DP9dKGaDlDrh1wv5jXTRWoVRkxkPuOSqnHFbuwHUJwXkgd8-gt6_KNOgegj75abwvvr95XCIigXC-c Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: 8ede055158e24b7c9a935b833e33b89a Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeTestJSON-361413854 Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:29:44.400173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:29:44.402380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8ede055158e24b7c9a935b833e33b89a", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8ede055158e24b7c9a935b833e33b89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8ede055158e24b7c9a935b833e33b89a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8ede055158e24b7c9a935b833e33b89a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:29:44.402380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeTestJSON-361413854 Aug 19 15:29:44.402380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 8ede055158e24b7c9a935b833e33b89a Aug 19 15:29:44.402380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361413854 Aug 19 15:29:44.402380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeTestJSON-361413854-project Aug 19 15:29:44.402380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:29:44.402380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:29:44.402380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: dc2bbdceb12641e6a0595e68f7cefd63 Aug 19 15:29:44.402380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeTestJSON-361413854-project Aug 19 15:29:44.402380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:29:44.402380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d could not be found. Aug 19 15:29:44.402380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': 'f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d'} Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d could not be found. Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:29:44.403289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:29:44.404829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:29:44.404829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:29:44.404829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:29:44.404829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:29:44.404829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:29:44.404829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:29:44.404829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:29:44.404829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d could not be found. Aug 19 15:29:44.404829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:29:44.404829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:29:44.404829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:29:44.404829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:29:44.404829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:29:44.404829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:29:44.404829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:29:44.404829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:29:44.404829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d could not be found. Aug 19 15:29:44.404829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:29:44.406128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b092b57e-a23d-4382-9ff6-39b8f7e90aa2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] Returning 404 to user: Instance f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:29:44.406128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b092b57e-a23d-4382-9ff6-39b8f7e90aa2 tempest-AttachVolumeTestJSON-361413854 tempest-AttachVolumeTestJSON-361413854-project] 10.222.0.75 "GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d" status: 404 len: 111 microversion: 2.1 time: 0.034283 Aug 19 15:29:44.406128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 382/772] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:29:44 2022] GET /compute/v2.1/servers/f4cf95c5-adc2-4d6b-8653-8c74b0b6eb8d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 15:29:49.900265 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5df91f1e-8859-42fe-b99e-5465b3baabc8 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:49.900908 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5df91f1e-8859-42fe-b99e-5465b3baabc8 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:49.907721 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5df91f1e-8859-42fe-b99e-5465b3baabc8 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:49.908209 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5df91f1e-8859-42fe-b99e-5465b3baabc8 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:49.908678 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5df91f1e-8859-42fe-b99e-5465b3baabc8 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:49.909370 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5df91f1e-8859-42fe-b99e-5465b3baabc8 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:49.909824 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5df91f1e-8859-42fe-b99e-5465b3baabc8 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:49.910246 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5df91f1e-8859-42fe-b99e-5465b3baabc8 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:49.933787 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5df91f1e-8859-42fe-b99e-5465b3baabc8 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd/ips" status: 200 len: 149 microversion: 2.1 time: 0.037297 Aug 19 15:29:49.934347 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 391/773] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Aug 19 15:29:49 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:29:51.274559 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-036bd074-5c5a-45f8-80b9-fdef567716ef tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "009b9347-9018-49e5-9448-5a41f9104905"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:29:51.276997 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-036bd074-5c5a-45f8-80b9-fdef567716ef tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:51.284715 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-036bd074-5c5a-45f8-80b9-fdef567716ef tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:51.285353 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-036bd074-5c5a-45f8-80b9-fdef567716ef tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:51.285843 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-036bd074-5c5a-45f8-80b9-fdef567716ef tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:51.286595 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-036bd074-5c5a-45f8-80b9-fdef567716ef tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:51.287108 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-036bd074-5c5a-45f8-80b9-fdef567716ef tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:51.287612 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-036bd074-5c5a-45f8-80b9-fdef567716ef tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:51.531683 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=92,nova_cell1:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:51.555599 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-036bd074-5c5a-45f8-80b9-fdef567716ef tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "POST /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286371 Aug 19 15:29:51.556249 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 383/774] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Aug 19 15:29:51 2022] POST /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:29:59.231453 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7c0bfed8-16a3-492a-a26d-506d707a2e81 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:59.232308 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7c0bfed8-16a3-492a-a26d-506d707a2e81 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:59.239960 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c0bfed8-16a3-492a-a26d-506d707a2e81 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:59.240477 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c0bfed8-16a3-492a-a26d-506d707a2e81 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:59.240911 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c0bfed8-16a3-492a-a26d-506d707a2e81 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:59.241611 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c0bfed8-16a3-492a-a26d-506d707a2e81 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:59.242088 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c0bfed8-16a3-492a-a26d-506d707a2e81 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:59.242505 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c0bfed8-16a3-492a-a26d-506d707a2e81 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:59.245137 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:59.331831 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-7c0bfed8-16a3-492a-a26d-506d707a2e81 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lazy-loading 'services' on Instance uuid 615eb3a5-68de-4e10-9e81-33393fa2b6cd {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:29:59.407908 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7c0bfed8-16a3-492a-a26d-506d707a2e81 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "DELETE /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd/os-volume_attachments/009b9347-9018-49e5-9448-5a41f9104905" status: 202 len: 0 microversion: 2.1 time: 0.180706 Aug 19 15:29:59.408516 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 392/775] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Aug 19 15:29:59 2022] DELETE /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd/os-volume_attachments/009b9347-9018-49e5-9448-5a41f9104905 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:29:59.418835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8ab9a435-ed20-4c8d-a12c-1fd61829d3b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:29:59.421369 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8ab9a435-ed20-4c8d-a12c-1fd61829d3b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:29:59.427853 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ab9a435-ed20-4c8d-a12c-1fd61829d3b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:59.428342 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ab9a435-ed20-4c8d-a12c-1fd61829d3b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:59.428840 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ab9a435-ed20-4c8d-a12c-1fd61829d3b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:59.429856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ab9a435-ed20-4c8d-a12c-1fd61829d3b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:29:59.430627 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ab9a435-ed20-4c8d-a12c-1fd61829d3b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:29:59.431194 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ab9a435-ed20-4c8d-a12c-1fd61829d3b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:29:59.463983 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8ab9a435-ed20-4c8d-a12c-1fd61829d3b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050597 Aug 19 15:29:59.464523 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 384/776] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:29:59 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:30:00.477758 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4f5b8c3d-85c8-482a-9add-6fd461ba5c5f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:00.480111 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4f5b8c3d-85c8-482a-9add-6fd461ba5c5f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:00.486368 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f5b8c3d-85c8-482a-9add-6fd461ba5c5f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:00.487436 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f5b8c3d-85c8-482a-9add-6fd461ba5c5f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:00.487956 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f5b8c3d-85c8-482a-9add-6fd461ba5c5f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:00.488622 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f5b8c3d-85c8-482a-9add-6fd461ba5c5f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:00.489080 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f5b8c3d-85c8-482a-9add-6fd461ba5c5f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:00.489561 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f5b8c3d-85c8-482a-9add-6fd461ba5c5f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:00.520811 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4f5b8c3d-85c8-482a-9add-6fd461ba5c5f tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047868 Aug 19 15:30:00.521366 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 393/777] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:30:00 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 15:30:00.587374 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3396b679-cf7a-48b7-84e8-d57af2a8fdf9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:00.588038 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3396b679-cf7a-48b7-84e8-d57af2a8fdf9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:00.594139 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3396b679-cf7a-48b7-84e8-d57af2a8fdf9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:00.594609 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3396b679-cf7a-48b7-84e8-d57af2a8fdf9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:00.595030 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3396b679-cf7a-48b7-84e8-d57af2a8fdf9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:00.595698 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3396b679-cf7a-48b7-84e8-d57af2a8fdf9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:00.596683 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3396b679-cf7a-48b7-84e8-d57af2a8fdf9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:00.597105 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3396b679-cf7a-48b7-84e8-d57af2a8fdf9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:00.622935 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3396b679-cf7a-48b7-84e8-d57af2a8fdf9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:30:00.702332 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3396b679-cf7a-48b7-84e8-d57af2a8fdf9 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "DELETE /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 204 len: 0 microversion: 2.1 time: 0.118710 Aug 19 15:30:00.706306 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 385/778] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:30:00 2022] DELETE /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 19 15:30:00.711743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b078d6a8-2245-4d17-87e6-8a286946b2a1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:00.712350 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b078d6a8-2245-4d17-87e6-8a286946b2a1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:00.718333 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b078d6a8-2245-4d17-87e6-8a286946b2a1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:00.718810 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b078d6a8-2245-4d17-87e6-8a286946b2a1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:00.719238 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b078d6a8-2245-4d17-87e6-8a286946b2a1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:00.719921 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b078d6a8-2245-4d17-87e6-8a286946b2a1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:00.720379 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b078d6a8-2245-4d17-87e6-8a286946b2a1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:00.720832 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b078d6a8-2245-4d17-87e6-8a286946b2a1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:00.856204 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b078d6a8-2245-4d17-87e6-8a286946b2a1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:00.864743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b078d6a8-2245-4d17-87e6-8a286946b2a1 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1681 microversion: 2.1 time: 0.156953 Aug 19 15:30:00.865344 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 394/779] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:30:00 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:30:01.887546 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f628c550-4f7f-46c1-813f-3c16d808d2a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:01.888240 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f628c550-4f7f-46c1-813f-3c16d808d2a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:01.896747 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f628c550-4f7f-46c1-813f-3c16d808d2a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:01.897235 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f628c550-4f7f-46c1-813f-3c16d808d2a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:01.897667 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f628c550-4f7f-46c1-813f-3c16d808d2a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:01.898458 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f628c550-4f7f-46c1-813f-3c16d808d2a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:01.899055 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f628c550-4f7f-46c1-813f-3c16d808d2a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:01.899478 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f628c550-4f7f-46c1-813f-3c16d808d2a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:02.041332 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f628c550-4f7f-46c1-813f-3c16d808d2a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:02.049281 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f628c550-4f7f-46c1-813f-3c16d808d2a3 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1681 microversion: 2.1 time: 0.166065 Aug 19 15:30:02.049890 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 386/780] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:30:01 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:30:03.071164 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eb9cada1-f401-42b2-8ba1-91c2503dfcb2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:03.071794 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eb9cada1-f401-42b2-8ba1-91c2503dfcb2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:03.082721 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb9cada1-f401-42b2-8ba1-91c2503dfcb2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:03.083571 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb9cada1-f401-42b2-8ba1-91c2503dfcb2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:03.084015 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb9cada1-f401-42b2-8ba1-91c2503dfcb2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:03.084906 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb9cada1-f401-42b2-8ba1-91c2503dfcb2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:03.085384 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb9cada1-f401-42b2-8ba1-91c2503dfcb2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:03.085798 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb9cada1-f401-42b2-8ba1-91c2503dfcb2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:03.219565 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eb9cada1-f401-42b2-8ba1-91c2503dfcb2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaa94a183fb49b79e6383ea783ab76d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf14c554d854af5ba8cd910c82d42e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:03.228475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eb9cada1-f401-42b2-8ba1-91c2503dfcb2 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 200 len: 1681 microversion: 2.1 time: 0.161154 Aug 19 15:30:03.229041 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 395/781] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:30:03 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:30:03.593873 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-7f46fc2c-af68-42a4-ad88-b95b82802fba req-45d11d4b-a8c8-4ade-9bd0-0da76ef1b8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "615eb3a5-68de-4e10-9e81-33393fa2b6cd", "name": "network-vif-deleted", "tag": "a6d9816f-451f-44af-8263-ece906a39b8f"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:30:03.605156 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-7f46fc2c-af68-42a4-ad88-b95b82802fba req-45d11d4b-a8c8-4ade-9bd0-0da76ef1b8c1 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:03.605669 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-7f46fc2c-af68-42a4-ad88-b95b82802fba req-45d11d4b-a8c8-4ade-9bd0-0da76ef1b8c1 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:03.606094 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-7f46fc2c-af68-42a4-ad88-b95b82802fba req-45d11d4b-a8c8-4ade-9bd0-0da76ef1b8c1 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:03.618211 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-7f46fc2c-af68-42a4-ad88-b95b82802fba req-45d11d4b-a8c8-4ade-9bd0-0da76ef1b8c1 service nova] Creating event network-vif-deleted:a6d9816f-451f-44af-8263-ece906a39b8f for instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd on hv-cinder-83538 Aug 19 15:30:03.624116 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-7f46fc2c-af68-42a4-ad88-b95b82802fba req-45d11d4b-a8c8-4ade-9bd0-0da76ef1b8c1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034360 Aug 19 15:30:03.624964 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 387/782] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:30:04.250770 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6eb60d2b-2685-4826-b2af-8276599c2579 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:04.251386 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6eb60d2b-2685-4826-b2af-8276599c2579 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:04.258293 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6eb60d2b-2685-4826-b2af-8276599c2579 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:04.258786 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6eb60d2b-2685-4826-b2af-8276599c2579 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:04.259195 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6eb60d2b-2685-4826-b2af-8276599c2579 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:04.259876 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6eb60d2b-2685-4826-b2af-8276599c2579 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:04.260319 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6eb60d2b-2685-4826-b2af-8276599c2579 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:04.260762 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6eb60d2b-2685-4826-b2af-8276599c2579 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:04.279506 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-6eb60d2b-2685-4826-b2af-8276599c2579 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] HTTP exception thrown: Instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd could not be found. Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6eb60d2b-2685-4826-b2af-8276599c2579 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Request method failure captured: Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd HTTP/1.1 Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6rjGIu42xaUfT_v0ZhOXSnvehT4QlYhL17z5n_oMEy5IgikNA5uN1BBFVSKHMDsc2O7a9I4Q5QwyQwXQspk3bwkVpeM9P9CWc98yKTuU8FguCcSJbu5xVwv6VOQ4CGubFMZO9oKGHBL5Wx4SbWH4Vr7DIv1aG8W2KhuYrqRW6sHXqA Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:30:04.281208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:30:04.282905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf14c554d854af5ba8cd910c82d42e0", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:30:04.282905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:04.282905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:30:04.282905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:04.282905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:30:04.282905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:30:04.282905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:30:04.282905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 4aaa94a183fb49b79e6383ea783ab76d Aug 19 15:30:04.282905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:30:04.282905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:30:04.282905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd could not be found. Aug 19 15:30:04.282905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': '615eb3a5-68de-4e10-9e81-33393fa2b6cd'} Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd could not be found. Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:30:04.284431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:30:04.286391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:30:04.286391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:30:04.286391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:30:04.286391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:30:04.286391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:30:04.286391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:30:04.286391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:30:04.286391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd could not be found. Aug 19 15:30:04.286391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:04.286391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:04.286391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:04.286391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:04.286391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:04.286391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:04.286391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:30:04.286391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:30:04.286391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd could not be found. Aug 19 15:30:04.286391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:04.288622 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6eb60d2b-2685-4826-b2af-8276599c2579 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Returning 404 to user: Instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:30:04.289780 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6eb60d2b-2685-4826-b2af-8276599c2579 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 404 len: 111 microversion: 2.1 time: 0.042899 Aug 19 15:30:04.290371 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 396/783] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:30:04 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 15:30:04.301550 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7cdcf514-9ab3-4fbb-be85-9e7e5be5f402 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '.version_select at 0x7fb533144940>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:04.321506 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7cdcf514-9ab3-4fbb-be85-9e7e5be5f402 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-982286609" status: 202 len: 0 microversion: 2.1 time: 0.025260 Aug 19 15:30:04.322214 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 388/784] 10.222.0.75 () {58 vars in 1218 bytes} [Fri Aug 19 15:30:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-982286609 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:30:06.140862 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-766c6413-526a-4be8-a99b-8296dce6e0d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:06.141447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-766c6413-526a-4be8-a99b-8296dce6e0d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:06.147755 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-766c6413-526a-4be8-a99b-8296dce6e0d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:06.148233 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-766c6413-526a-4be8-a99b-8296dce6e0d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:06.148700 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-766c6413-526a-4be8-a99b-8296dce6e0d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:06.149383 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-766c6413-526a-4be8-a99b-8296dce6e0d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:06.149832 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-766c6413-526a-4be8-a99b-8296dce6e0d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:06.150251 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-766c6413-526a-4be8-a99b-8296dce6e0d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:06.165168 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-766c6413-526a-4be8-a99b-8296dce6e0d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] HTTP exception thrown: Instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd could not be found. Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-766c6413-526a-4be8-a99b-8296dce6e0d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Request method failure captured: Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd HTTP/1.1 Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6rjGIu42xaUfT_v0ZhOXSnvehT4QlYhL17z5n_oMEy5IgikNA5uN1BBFVSKHMDsc2O7a9I4Q5QwyQwXQspk3bwkVpeM9P9CWc98yKTuU8FguCcSJbu5xVwv6VOQ4CGubFMZO9oKGHBL5Wx4SbWH4Vr7DIv1aG8W2KhuYrqRW6sHXqA Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:30:06.166708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:30:06.168237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf14c554d854af5ba8cd910c82d42e0", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:30:06.168237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:06.168237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:30:06.168237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:06.168237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:30:06.168237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:30:06.168237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:30:06.168237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 4aaa94a183fb49b79e6383ea783ab76d Aug 19 15:30:06.168237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:30:06.168237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:30:06.168237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd could not be found. Aug 19 15:30:06.168237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': '615eb3a5-68de-4e10-9e81-33393fa2b6cd'} Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd could not be found. Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:30:06.169171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd could not be found. Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd could not be found. Aug 19 15:30:06.170588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:06.172089 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-766c6413-526a-4be8-a99b-8296dce6e0d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Returning 404 to user: Instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:30:06.172089 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-766c6413-526a-4be8-a99b-8296dce6e0d6 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "DELETE /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 404 len: 111 microversion: 2.1 time: 0.031103 Aug 19 15:30:06.172089 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 397/785] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:30:06 2022] DELETE /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:30:06.177711 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5236288c-dc5a-4df3-87eb-749d24be9dde tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:06.178472 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5236288c-dc5a-4df3-87eb-749d24be9dde tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 615eb3a5-68de-4e10-9e81-33393fa2b6cd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:06.187639 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5236288c-dc5a-4df3-87eb-749d24be9dde tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:06.188122 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5236288c-dc5a-4df3-87eb-749d24be9dde tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:06.188589 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5236288c-dc5a-4df3-87eb-749d24be9dde tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:06.189278 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5236288c-dc5a-4df3-87eb-749d24be9dde tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:06.189727 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5236288c-dc5a-4df3-87eb-749d24be9dde tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:06.190386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5236288c-dc5a-4df3-87eb-749d24be9dde tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:06.203224 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-5236288c-dc5a-4df3-87eb-749d24be9dde tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] HTTP exception thrown: Instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd could not be found. Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5236288c-dc5a-4df3-87eb-749d24be9dde tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Request method failure captured: Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd HTTP/1.1 Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6rjGIu42xaUfT_v0ZhOXSnvehT4QlYhL17z5n_oMEy5IgikNA5uN1BBFVSKHMDsc2O7a9I4Q5QwyQwXQspk3bwkVpeM9P9CWc98yKTuU8FguCcSJbu5xVwv6VOQ4CGubFMZO9oKGHBL5Wx4SbWH4Vr7DIv1aG8W2KhuYrqRW6sHXqA Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:30:06.204955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:30:06.206927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf14c554d854af5ba8cd910c82d42e0", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:30:06.206927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:06.206927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:30:06.206927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:06.206927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:30:06.206927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:30:06.206927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:30:06.206927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: 4aaa94a183fb49b79e6383ea783ab76d Aug 19 15:30:06.206927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:30:06.206927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:30:06.206927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd could not be found. Aug 19 15:30:06.206927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': '615eb3a5-68de-4e10-9e81-33393fa2b6cd'} Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd could not be found. Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:30:06.207869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:30:06.209343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:30:06.209343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:30:06.209343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:30:06.209343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:30:06.209343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:30:06.209343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:30:06.209343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:30:06.209343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd could not be found. Aug 19 15:30:06.209343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:06.209343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:06.209343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:06.209343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:06.209343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:06.209343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:06.209343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:30:06.209343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:30:06.209343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd could not be found. Aug 19 15:30:06.209343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:06.210560 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5236288c-dc5a-4df3-87eb-749d24be9dde tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Returning 404 to user: Instance 615eb3a5-68de-4e10-9e81-33393fa2b6cd could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:30:06.210560 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5236288c-dc5a-4df3-87eb-749d24be9dde tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd" status: 404 len: 111 microversion: 2.1 time: 0.033512 Aug 19 15:30:06.210560 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 389/786] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:30:06 2022] GET /compute/v2.1/servers/615eb3a5-68de-4e10-9e81-33393fa2b6cd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:30:07.354886 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9391e61d-fe2e-43d6-87e0-724550252f15 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:07.355404 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9391e61d-fe2e-43d6-87e0-724550252f15 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:07.365230 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9391e61d-fe2e-43d6-87e0-724550252f15 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:07.365703 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9391e61d-fe2e-43d6-87e0-724550252f15 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:07.366257 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9391e61d-fe2e-43d6-87e0-724550252f15 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:07.366861 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9391e61d-fe2e-43d6-87e0-724550252f15 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:07.367313 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9391e61d-fe2e-43d6-87e0-724550252f15 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:07.367734 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9391e61d-fe2e-43d6-87e0-724550252f15 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:07.382926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-9391e61d-fe2e-43d6-87e0-724550252f15 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] HTTP exception thrown: Instance 99291255-ef9c-4d2a-a163-35693eb609e8 could not be found. Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9391e61d-fe2e-43d6-87e0-724550252f15 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Request method failure captured: Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 HTTP/1.1 Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6rjGIu42xaUfT_v0ZhOXSnvehT4QlYhL17z5n_oMEy5IgikNA5uN1BBFVSKHMDsc2O7a9I4Q5QwyQwXQspk3bwkVpeM9P9CWc98yKTuU8FguCcSJbu5xVwv6VOQ4CGubFMZO9oKGHBL5Wx4SbWH4Vr7DIv1aG8W2KhuYrqRW6sHXqA Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:30:07.384482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:30:07.386128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf14c554d854af5ba8cd910c82d42e0", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:30:07.386128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:07.386128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:30:07.386128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:07.386128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:30:07.386128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:30:07.386128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:30:07.386128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 4aaa94a183fb49b79e6383ea783ab76d Aug 19 15:30:07.386128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:30:07.386128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:30:07.386128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance 99291255-ef9c-4d2a-a163-35693eb609e8 could not be found. Aug 19 15:30:07.386128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': '99291255-ef9c-4d2a-a163-35693eb609e8'} Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99291255-ef9c-4d2a-a163-35693eb609e8 could not be found. Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:30:07.386941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99291255-ef9c-4d2a-a163-35693eb609e8 could not be found. Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99291255-ef9c-4d2a-a163-35693eb609e8 could not be found. Aug 19 15:30:07.388221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.389643 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9391e61d-fe2e-43d6-87e0-724550252f15 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Returning 404 to user: Instance 99291255-ef9c-4d2a-a163-35693eb609e8 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:30:07.389643 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9391e61d-fe2e-43d6-87e0-724550252f15 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "DELETE /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 404 len: 111 microversion: 2.1 time: 0.040946 Aug 19 15:30:07.389643 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 398/787] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:30:07 2022] DELETE /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:30:07.395687 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b3502cf0-b1fa-473b-88f5-093eb2874148 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:07.396616 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b3502cf0-b1fa-473b-88f5-093eb2874148 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: 99291255-ef9c-4d2a-a163-35693eb609e8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:07.402994 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3502cf0-b1fa-473b-88f5-093eb2874148 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:07.403476 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3502cf0-b1fa-473b-88f5-093eb2874148 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:07.403910 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3502cf0-b1fa-473b-88f5-093eb2874148 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:07.404629 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3502cf0-b1fa-473b-88f5-093eb2874148 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:07.405084 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3502cf0-b1fa-473b-88f5-093eb2874148 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:07.405506 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3502cf0-b1fa-473b-88f5-093eb2874148 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:07.418478 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-b3502cf0-b1fa-473b-88f5-093eb2874148 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] HTTP exception thrown: Instance 99291255-ef9c-4d2a-a163-35693eb609e8 could not be found. Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b3502cf0-b1fa-473b-88f5-093eb2874148 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Request method failure captured: Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 HTTP/1.1 Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6rjGIu42xaUfT_v0ZhOXSnvehT4QlYhL17z5n_oMEy5IgikNA5uN1BBFVSKHMDsc2O7a9I4Q5QwyQwXQspk3bwkVpeM9P9CWc98yKTuU8FguCcSJbu5xVwv6VOQ4CGubFMZO9oKGHBL5Wx4SbWH4Vr7DIv1aG8W2KhuYrqRW6sHXqA Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:30:07.419989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:30:07.421627 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf14c554d854af5ba8cd910c82d42e0", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:30:07.421627 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:07.421627 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:30:07.421627 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:07.421627 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:30:07.421627 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:30:07.421627 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:30:07.421627 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: 4aaa94a183fb49b79e6383ea783ab76d Aug 19 15:30:07.421627 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:30:07.421627 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:30:07.421627 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Instance 99291255-ef9c-4d2a-a163-35693eb609e8 could not be found. Aug 19 15:30:07.421627 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': '99291255-ef9c-4d2a-a163-35693eb609e8'} Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99291255-ef9c-4d2a-a163-35693eb609e8 could not be found. Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:30:07.422489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:30:07.423835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:30:07.423835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:30:07.423835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:30:07.423835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:30:07.423835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:30:07.423835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:30:07.423835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:30:07.423835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99291255-ef9c-4d2a-a163-35693eb609e8 could not be found. Aug 19 15:30:07.423835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.423835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:07.423835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.423835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:07.423835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:07.423835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:07.423835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:30:07.423835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:30:07.423835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99291255-ef9c-4d2a-a163-35693eb609e8 could not be found. Aug 19 15:30:07.423835 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.426110 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b3502cf0-b1fa-473b-88f5-093eb2874148 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Returning 404 to user: Instance 99291255-ef9c-4d2a-a163-35693eb609e8 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:30:07.426110 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b3502cf0-b1fa-473b-88f5-093eb2874148 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8" status: 404 len: 111 microversion: 2.1 time: 0.030499 Aug 19 15:30:07.426110 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 390/788] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:30:07 2022] GET /compute/v2.1/servers/99291255-ef9c-4d2a-a163-35693eb609e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:30:07.430244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-582b9c9a-1aff-4487-8de0-a4e0505c8e9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:07.430795 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-582b9c9a-1aff-4487-8de0-a4e0505c8e9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:07.436735 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-582b9c9a-1aff-4487-8de0-a4e0505c8e9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:07.437205 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-582b9c9a-1aff-4487-8de0-a4e0505c8e9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:07.437630 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-582b9c9a-1aff-4487-8de0-a4e0505c8e9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:07.438300 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-582b9c9a-1aff-4487-8de0-a4e0505c8e9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:07.438742 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-582b9c9a-1aff-4487-8de0-a4e0505c8e9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:07.439154 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-582b9c9a-1aff-4487-8de0-a4e0505c8e9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:07.452659 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-582b9c9a-1aff-4487-8de0-a4e0505c8e9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] HTTP exception thrown: Instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 could not be found. Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-582b9c9a-1aff-4487-8de0-a4e0505c8e9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Request method failure captured: Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 HTTP/1.1 Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6rjGIu42xaUfT_v0ZhOXSnvehT4QlYhL17z5n_oMEy5IgikNA5uN1BBFVSKHMDsc2O7a9I4Q5QwyQwXQspk3bwkVpeM9P9CWc98yKTuU8FguCcSJbu5xVwv6VOQ4CGubFMZO9oKGHBL5Wx4SbWH4Vr7DIv1aG8W2KhuYrqRW6sHXqA Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:30:07.454144 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:30:07.456447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf14c554d854af5ba8cd910c82d42e0", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:30:07.456447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:07.456447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:30:07.456447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:07.456447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:30:07.456447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:30:07.456447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:30:07.456447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 4aaa94a183fb49b79e6383ea783ab76d Aug 19 15:30:07.456447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:30:07.456447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:30:07.456447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 could not be found. Aug 19 15:30:07.456447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': 'd4717c9f-2cd2-419b-a91c-7f722d99dd27'} Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 could not be found. Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:30:07.457478 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 could not be found. Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 could not be found. Aug 19 15:30:07.458947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.460359 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-582b9c9a-1aff-4487-8de0-a4e0505c8e9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Returning 404 to user: Instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:30:07.460359 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-582b9c9a-1aff-4487-8de0-a4e0505c8e9e tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 404 len: 111 microversion: 2.1 time: 0.028990 Aug 19 15:30:07.460359 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 399/789] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:30:07 2022] DELETE /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:30:07.464511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c79acad1-c5c5-4468-8f68-61459fa4a5b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:07.465148 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c79acad1-c5c5-4468-8f68-61459fa4a5b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: d4717c9f-2cd2-419b-a91c-7f722d99dd27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:07.471049 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c79acad1-c5c5-4468-8f68-61459fa4a5b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:07.471529 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c79acad1-c5c5-4468-8f68-61459fa4a5b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:07.471953 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c79acad1-c5c5-4468-8f68-61459fa4a5b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:07.472664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c79acad1-c5c5-4468-8f68-61459fa4a5b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:07.473115 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c79acad1-c5c5-4468-8f68-61459fa4a5b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:07.473567 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c79acad1-c5c5-4468-8f68-61459fa4a5b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:07.486687 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-c79acad1-c5c5-4468-8f68-61459fa4a5b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] HTTP exception thrown: Instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 could not be found. Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c79acad1-c5c5-4468-8f68-61459fa4a5b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Request method failure captured: Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 HTTP/1.1 Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6rjGIu42xaUfT_v0ZhOXSnvehT4QlYhL17z5n_oMEy5IgikNA5uN1BBFVSKHMDsc2O7a9I4Q5QwyQwXQspk3bwkVpeM9P9CWc98yKTuU8FguCcSJbu5xVwv6VOQ4CGubFMZO9oKGHBL5Wx4SbWH4Vr7DIv1aG8W2KhuYrqRW6sHXqA Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:30:07.488314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:30:07.489980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf14c554d854af5ba8cd910c82d42e0", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:30:07.489980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:07.489980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:30:07.489980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:07.489980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:30:07.489980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:30:07.489980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:30:07.489980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: 4aaa94a183fb49b79e6383ea783ab76d Aug 19 15:30:07.489980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:30:07.489980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:30:07.489980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 could not be found. Aug 19 15:30:07.489980 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': 'd4717c9f-2cd2-419b-a91c-7f722d99dd27'} Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 could not be found. Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:30:07.490830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:30:07.492174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:30:07.492174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:30:07.492174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:30:07.492174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:30:07.492174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:30:07.492174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:30:07.492174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:30:07.492174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 could not be found. Aug 19 15:30:07.492174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.492174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:07.492174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.492174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:07.492174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:07.492174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:07.492174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:30:07.492174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:30:07.492174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 could not be found. Aug 19 15:30:07.492174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:07.493303 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c79acad1-c5c5-4468-8f68-61459fa4a5b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Returning 404 to user: Instance d4717c9f-2cd2-419b-a91c-7f722d99dd27 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:30:07.493303 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c79acad1-c5c5-4468-8f68-61459fa4a5b4 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27" status: 404 len: 111 microversion: 2.1 time: 0.029155 Aug 19 15:30:07.493303 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 391/790] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:30:07 2022] GET /compute/v2.1/servers/d4717c9f-2cd2-419b-a91c-7f722d99dd27 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:30:08.528910 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-576f8ac3-c9f6-4b08-bc22-c5640935fda2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:08.529467 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-576f8ac3-c9f6-4b08-bc22-c5640935fda2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:08.536646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-576f8ac3-c9f6-4b08-bc22-c5640935fda2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:08.537107 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-576f8ac3-c9f6-4b08-bc22-c5640935fda2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:08.537555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-576f8ac3-c9f6-4b08-bc22-c5640935fda2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:08.538236 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-576f8ac3-c9f6-4b08-bc22-c5640935fda2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:08.538678 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-576f8ac3-c9f6-4b08-bc22-c5640935fda2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:08.539092 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-576f8ac3-c9f6-4b08-bc22-c5640935fda2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:08.562098 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-576f8ac3-c9f6-4b08-bc22-c5640935fda2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd/ips" status: 200 len: 151 microversion: 2.20 time: 0.037001 Aug 19 15:30:08.562657 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 400/791] 10.222.0.75 () {60 vars in 1289 bytes} [Fri Aug 19 15:30:08 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 15:30:08.650000 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-15e98976-1364-499b-acc8-e758fa9e9905 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:08.650526 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-15e98976-1364-499b-acc8-e758fa9e9905 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:08.659969 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15e98976-1364-499b-acc8-e758fa9e9905 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:08.662418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15e98976-1364-499b-acc8-e758fa9e9905 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:08.663215 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15e98976-1364-499b-acc8-e758fa9e9905 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:08.664470 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15e98976-1364-499b-acc8-e758fa9e9905 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:08.665157 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15e98976-1364-499b-acc8-e758fa9e9905 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:08.665686 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15e98976-1364-499b-acc8-e758fa9e9905 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:08.682727 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-15e98976-1364-499b-acc8-e758fa9e9905 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] HTTP exception thrown: Instance c13d4563-5477-4605-9b1b-85113d779753 could not be found. Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-15e98976-1364-499b-acc8-e758fa9e9905 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Request method failure captured: Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 HTTP/1.1 Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6rjGIu42xaUfT_v0ZhOXSnvehT4QlYhL17z5n_oMEy5IgikNA5uN1BBFVSKHMDsc2O7a9I4Q5QwyQwXQspk3bwkVpeM9P9CWc98yKTuU8FguCcSJbu5xVwv6VOQ4CGubFMZO9oKGHBL5Wx4SbWH4Vr7DIv1aG8W2KhuYrqRW6sHXqA Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:30:08.684406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:30:08.685895 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf14c554d854af5ba8cd910c82d42e0", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:30:08.685895 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:08.685895 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:30:08.685895 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:08.685895 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:30:08.685895 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:30:08.685895 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:30:08.685895 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: 4aaa94a183fb49b79e6383ea783ab76d Aug 19 15:30:08.685895 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:30:08.685895 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:30:08.685895 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Instance c13d4563-5477-4605-9b1b-85113d779753 could not be found. Aug 19 15:30:08.685895 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': 'c13d4563-5477-4605-9b1b-85113d779753'} Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c13d4563-5477-4605-9b1b-85113d779753 could not be found. Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:30:08.686649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c13d4563-5477-4605-9b1b-85113d779753 could not be found. Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c13d4563-5477-4605-9b1b-85113d779753 could not be found. Aug 19 15:30:08.688325 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:30:08.690084 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-15e98976-1364-499b-acc8-e758fa9e9905 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Returning 404 to user: Instance c13d4563-5477-4605-9b1b-85113d779753 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:30:08.690084 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-15e98976-1364-499b-acc8-e758fa9e9905 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 404 len: 111 microversion: 2.1 time: 0.040833 Aug 19 15:30:08.690084 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 392/792] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:30:08 2022] DELETE /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:30:08.695888 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6a8c8f16-5b87-4ed8-8cf5-20869750b188 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:08.696534 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6a8c8f16-5b87-4ed8-8cf5-20869750b188 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] [instance: c13d4563-5477-4605-9b1b-85113d779753] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:08.702857 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a8c8f16-5b87-4ed8-8cf5-20869750b188 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:08.703340 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a8c8f16-5b87-4ed8-8cf5-20869750b188 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:08.708332 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a8c8f16-5b87-4ed8-8cf5-20869750b188 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:08.708332 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a8c8f16-5b87-4ed8-8cf5-20869750b188 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:08.708332 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a8c8f16-5b87-4ed8-8cf5-20869750b188 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:08.708332 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a8c8f16-5b87-4ed8-8cf5-20869750b188 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:08.720046 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-6a8c8f16-5b87-4ed8-8cf5-20869750b188 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] HTTP exception thrown: Instance c13d4563-5477-4605-9b1b-85113d779753 could not be found. Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6a8c8f16-5b87-4ed8-8cf5-20869750b188 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Request method failure captured: Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 HTTP/1.1 Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6rjGIu42xaUfT_v0ZhOXSnvehT4QlYhL17z5n_oMEy5IgikNA5uN1BBFVSKHMDsc2O7a9I4Q5QwyQwXQspk3bwkVpeM9P9CWc98yKTuU8FguCcSJbu5xVwv6VOQ4CGubFMZO9oKGHBL5Wx4SbWH4Vr7DIv1aG8W2KhuYrqRW6sHXqA Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:30:08.721725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:30:08.724166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cbf14c554d854af5ba8cd910c82d42e0", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cbf14c554d854af5ba8cd910c82d42e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:30:08.724166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:08.724166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: cbf14c554d854af5ba8cd910c82d42e0 Aug 19 15:30:08.724166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-152380103 Aug 19 15:30:08.724166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:30:08.724166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:30:08.724166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:30:08.724166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 4aaa94a183fb49b79e6383ea783ab76d Aug 19 15:30:08.724166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-152380103-project Aug 19 15:30:08.724166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:30:08.724166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance c13d4563-5477-4605-9b1b-85113d779753 could not be found. Aug 19 15:30:08.724166 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': 'c13d4563-5477-4605-9b1b-85113d779753'} Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c13d4563-5477-4605-9b1b-85113d779753 could not be found. Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:30:08.725170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:30:08.726663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:30:08.726663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:30:08.726663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:30:08.726663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:30:08.726663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:30:08.726663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:30:08.726663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:30:08.726663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c13d4563-5477-4605-9b1b-85113d779753 could not be found. Aug 19 15:30:08.726663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:08.726663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:08.726663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:08.726663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:08.726663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:08.726663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:08.726663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:30:08.726663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:30:08.726663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c13d4563-5477-4605-9b1b-85113d779753 could not be found. Aug 19 15:30:08.726663 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:08.727941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6a8c8f16-5b87-4ed8-8cf5-20869750b188 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] Returning 404 to user: Instance c13d4563-5477-4605-9b1b-85113d779753 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:30:08.727941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6a8c8f16-5b87-4ed8-8cf5-20869750b188 tempest-AttachVolumeNegativeTest-152380103 tempest-AttachVolumeNegativeTest-152380103-project] 10.222.0.75 "GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753" status: 404 len: 111 microversion: 2.1 time: 0.032008 Aug 19 15:30:08.727941 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 401/793] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:30:08 2022] GET /compute/v2.1/servers/c13d4563-5477-4605-9b1b-85113d779753 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:30:10.774341 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-297e4bf2-9c68-41ba-abe1-9d539da48adb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:30:10.775500 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-297e4bf2-9c68-41ba-abe1-9d539da48adb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:10.782746 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-297e4bf2-9c68-41ba-abe1-9d539da48adb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:10.783417 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-297e4bf2-9c68-41ba-abe1-9d539da48adb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:10.784035 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-297e4bf2-9c68-41ba-abe1-9d539da48adb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:10.785115 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-297e4bf2-9c68-41ba-abe1-9d539da48adb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:10.786846 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-297e4bf2-9c68-41ba-abe1-9d539da48adb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:10.787435 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-297e4bf2-9c68-41ba-abe1-9d539da48adb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:10.817712 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-297e4bf2-9c68-41ba-abe1-9d539da48adb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lazy-loading 'flavor' on Instance uuid 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:30:11.070440 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-297e4bf2-9c68-41ba-abe1-9d539da48adb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "POST /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd/action" status: 202 len: 0 microversion: 2.20 time: 0.300947 Aug 19 15:30:11.071913 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 393/794] 10.222.0.75 () {62 vars in 1319 bytes} [Fri Aug 19 15:30:10 2022] POST /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:30:11.081349 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c0cb02e2-1a31-4787-94c6-d49354e056d5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:11.083409 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c0cb02e2-1a31-4787-94c6-d49354e056d5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:11.091644 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0cb02e2-1a31-4787-94c6-d49354e056d5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:11.092155 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0cb02e2-1a31-4787-94c6-d49354e056d5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:11.092811 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0cb02e2-1a31-4787-94c6-d49354e056d5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:11.094057 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0cb02e2-1a31-4787-94c6-d49354e056d5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:11.094896 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0cb02e2-1a31-4787-94c6-d49354e056d5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:11.095683 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0cb02e2-1a31-4787-94c6-d49354e056d5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:11.408677 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c0cb02e2-1a31-4787-94c6-d49354e056d5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:11.418496 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c0cb02e2-1a31-4787-94c6-d49354e056d5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:11.420085 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c0cb02e2-1a31-4787-94c6-d49354e056d5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:11.421689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c0cb02e2-1a31-4787-94c6-d49354e056d5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1722 microversion: 2.20 time: 0.344077 Aug 19 15:30:11.422272 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 402/795] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:11 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1722 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:12.447536 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b63ed0d1-c1ca-4923-b23f-48c7ae5499f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:12.448243 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b63ed0d1-c1ca-4923-b23f-48c7ae5499f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:12.455947 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b63ed0d1-c1ca-4923-b23f-48c7ae5499f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:12.456477 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b63ed0d1-c1ca-4923-b23f-48c7ae5499f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:12.456949 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b63ed0d1-c1ca-4923-b23f-48c7ae5499f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:12.458401 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b63ed0d1-c1ca-4923-b23f-48c7ae5499f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:12.459005 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b63ed0d1-c1ca-4923-b23f-48c7ae5499f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:12.459364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b63ed0d1-c1ca-4923-b23f-48c7ae5499f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:12.642357 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b63ed0d1-c1ca-4923-b23f-48c7ae5499f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:12.652820 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b63ed0d1-c1ca-4923-b23f-48c7ae5499f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:12.654668 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b63ed0d1-c1ca-4923-b23f-48c7ae5499f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:12.656065 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b63ed0d1-c1ca-4923-b23f-48c7ae5499f6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1722 microversion: 2.20 time: 0.213566 Aug 19 15:30:12.656806 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 394/796] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:12 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:13.679999 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8b35f54d-33b6-457e-8bcc-3607c3b0e9dd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:13.683188 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8b35f54d-33b6-457e-8bcc-3607c3b0e9dd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:13.689318 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b35f54d-33b6-457e-8bcc-3607c3b0e9dd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:13.690006 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b35f54d-33b6-457e-8bcc-3607c3b0e9dd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:13.690614 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b35f54d-33b6-457e-8bcc-3607c3b0e9dd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:13.692010 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b35f54d-33b6-457e-8bcc-3607c3b0e9dd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:13.692588 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b35f54d-33b6-457e-8bcc-3607c3b0e9dd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:13.693084 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b35f54d-33b6-457e-8bcc-3607c3b0e9dd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:13.699310 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c90d86e2-941c-4db6-8715-396e07cef58b tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] Action: 'create', calling method: .version_select at 0x7fb5332920d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-705746547", "metadata": {"Type": "work"}}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:30:13.843152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b35f54d-33b6-457e-8bcc-3607c3b0e9dd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:13.854034 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b35f54d-33b6-457e-8bcc-3607c3b0e9dd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:13.855539 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b35f54d-33b6-457e-8bcc-3607c3b0e9dd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:13.856927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8b35f54d-33b6-457e-8bcc-3607c3b0e9dd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1722 microversion: 2.20 time: 0.181623 Aug 19 15:30:13.857659 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 395/797] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:13 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 15:30:14.030067 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c90d86e2-941c-4db6-8715-396e07cef58b tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.448776 Aug 19 15:30:14.031003 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 403/798] 10.222.0.75 () {60 vars in 1156 bytes} [Fri Aug 19 15:30:13 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 451 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 19 15:30:14.043733 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e07ac45d-ff1f-4268-aa78-440d28da7289 tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] Calling method '.version_select at 0x7fb533158820>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:14.094623 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e07ac45d-ff1f-4268-aa78-440d28da7289 tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13" status: 200 len: 352 microversion: 2.1 time: 0.054688 Aug 19 15:30:14.096558 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 396/799] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Aug 19 15:30:14 2022] GET /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:30:14.881858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-262c1d21-f4da-4e27-b90e-c74878721e53 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:14.882496 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-262c1d21-f4da-4e27-b90e-c74878721e53 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:14.884644 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=28 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:30:14.891824 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-262c1d21-f4da-4e27-b90e-c74878721e53 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:14.892306 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-262c1d21-f4da-4e27-b90e-c74878721e53 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:14.892759 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-262c1d21-f4da-4e27-b90e-c74878721e53 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:14.893446 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-262c1d21-f4da-4e27-b90e-c74878721e53 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:14.893892 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-262c1d21-f4da-4e27-b90e-c74878721e53 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:14.894309 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-262c1d21-f4da-4e27-b90e-c74878721e53 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:15.022921 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-262c1d21-f4da-4e27-b90e-c74878721e53 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:15.031096 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-262c1d21-f4da-4e27-b90e-c74878721e53 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:15.032624 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-262c1d21-f4da-4e27-b90e-c74878721e53 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:15.033765 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-262c1d21-f4da-4e27-b90e-c74878721e53 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1722 microversion: 2.20 time: 0.156391 Aug 19 15:30:15.034315 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 404/800] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:14 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:15.109902 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ee74993-3bd3-4468-ab52-c6aab16fc0c5 tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] Calling method '.version_select at 0x7fb5331af8b0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:15.162224 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ee74993-3bd3-4468-ab52-c6aab16fc0c5 tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13" status: 200 len: 352 microversion: 2.1 time: 0.056509 Aug 19 15:30:15.162788 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 397/801] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Aug 19 15:30:15 2022] GET /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:30:16.057481 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b147513a-aaf0-4fbe-b18b-4ad22891930e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:16.058084 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b147513a-aaf0-4fbe-b18b-4ad22891930e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:16.064559 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b147513a-aaf0-4fbe-b18b-4ad22891930e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:16.065038 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b147513a-aaf0-4fbe-b18b-4ad22891930e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:16.065466 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b147513a-aaf0-4fbe-b18b-4ad22891930e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:16.066148 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b147513a-aaf0-4fbe-b18b-4ad22891930e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:16.066597 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b147513a-aaf0-4fbe-b18b-4ad22891930e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:16.067592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b147513a-aaf0-4fbe-b18b-4ad22891930e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:16.176761 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ad339c7-b13d-4759-be3b-d1c7627d45e6 tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] Calling method '.version_select at 0x7fb533144550>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:16.205753 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b147513a-aaf0-4fbe-b18b-4ad22891930e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:16.215219 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b147513a-aaf0-4fbe-b18b-4ad22891930e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:16.216780 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b147513a-aaf0-4fbe-b18b-4ad22891930e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:16.218002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b147513a-aaf0-4fbe-b18b-4ad22891930e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1722 microversion: 2.20 time: 0.164482 Aug 19 15:30:16.218599 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 405/802] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:16 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 15:30:16.378806 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ad339c7-b13d-4759-be3b-d1c7627d45e6 tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13" status: 200 len: 352 microversion: 2.1 time: 0.206653 Aug 19 15:30:16.379952 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 398/803] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Aug 19 15:30:16 2022] GET /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13 => generated 352 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:30:16.750769 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-be9576a4-3194-4bb3-ae8b-a58eff9f27d3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1878551085"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:30:16.751293 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-be9576a4-3194-4bb3-ae8b-a58eff9f27d3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:16.758503 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be9576a4-3194-4bb3-ae8b-a58eff9f27d3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:16.758978 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be9576a4-3194-4bb3-ae8b-a58eff9f27d3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:16.759421 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be9576a4-3194-4bb3-ae8b-a58eff9f27d3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:16.760196 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be9576a4-3194-4bb3-ae8b-a58eff9f27d3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:16.760907 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be9576a4-3194-4bb3-ae8b-a58eff9f27d3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:16.761281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be9576a4-3194-4bb3-ae8b-a58eff9f27d3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:16.886387 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.network.security_group_api [None req-be9576a4-3194-4bb3-ae8b-a58eff9f27d3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Removing security group 03329b8d-b452-4f81-b221-e26ad361f53c from port 8e0d422a-3a6d-4e22-8237-a99f06f45464 Aug 19 15:30:17.199549 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-be9576a4-3194-4bb3-ae8b-a58eff9f27d3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "POST /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5/action" status: 202 len: 0 microversion: 2.1 time: 0.452720 Aug 19 15:30:17.211413 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-45fec624-cbce-4b78-b532-277dd36f0242 req-3933c1ed-84dc-4e2f-a955-2fc535927d1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc81caa-949a-42ac-b696-7bb7cb9c5fd5", "tag": "8e0d422a-3a6d-4e22-8237-a99f06f45464"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:30:17.212084 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 406/804] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Aug 19 15:30:16 2022] POST /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:30:17.219351 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:30:17.226215 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-45fec624-cbce-4b78-b532-277dd36f0242 req-3933c1ed-84dc-4e2f-a955-2fc535927d1a service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:17.227009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-45fec624-cbce-4b78-b532-277dd36f0242 req-3933c1ed-84dc-4e2f-a955-2fc535927d1a service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:17.227649 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-45fec624-cbce-4b78-b532-277dd36f0242 req-3933c1ed-84dc-4e2f-a955-2fc535927d1a service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:17.243482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a7ac3209-18cc-4ee3-b8ec-72ac9365d9a7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:17.244482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a7ac3209-18cc-4ee3-b8ec-72ac9365d9a7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:17.257851 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7ac3209-18cc-4ee3-b8ec-72ac9365d9a7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:17.258396 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-45fec624-cbce-4b78-b532-277dd36f0242 req-3933c1ed-84dc-4e2f-a955-2fc535927d1a service nova] Creating event network-changed:8e0d422a-3a6d-4e22-8237-a99f06f45464 for instance 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 on hv-cinder-83538 Aug 19 15:30:17.262924 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7ac3209-18cc-4ee3-b8ec-72ac9365d9a7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:17.263653 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7ac3209-18cc-4ee3-b8ec-72ac9365d9a7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:17.267439 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7ac3209-18cc-4ee3-b8ec-72ac9365d9a7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:17.268343 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7ac3209-18cc-4ee3-b8ec-72ac9365d9a7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:17.269062 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7ac3209-18cc-4ee3-b8ec-72ac9365d9a7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:17.269657 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-45fec624-cbce-4b78-b532-277dd36f0242 req-3933c1ed-84dc-4e2f-a955-2fc535927d1a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060679 Aug 19 15:30:17.274360 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 399/805] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:30:17.397876 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7ed9f038-c386-45fa-a752-446bdefa298a tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] Calling method '.version_select at 0x7fb5331af040>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:17.459043 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a7ac3209-18cc-4ee3-b8ec-72ac9365d9a7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:17.469194 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a7ac3209-18cc-4ee3-b8ec-72ac9365d9a7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:17.474621 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a7ac3209-18cc-4ee3-b8ec-72ac9365d9a7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:17.478631 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a7ac3209-18cc-4ee3-b8ec-72ac9365d9a7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1722 microversion: 2.20 time: 0.240830 Aug 19 15:30:17.480463 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 407/806] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:17 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 15:30:17.491167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7ed9f038-c386-45fa-a752-446bdefa298a tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13" status: 200 len: 352 microversion: 2.1 time: 0.100920 Aug 19 15:30:17.492245 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 400/807] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Aug 19 15:30:17 2022] GET /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:30:18.510610 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7331425c-7b54-4542-b9ef-a534be609ce2 tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] Calling method '.version_select at 0x7fb53331b4c0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:18.517756 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9aa30504-7fa6-4b63-9139-5752ae0a712c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:18.518488 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9aa30504-7fa6-4b63-9139-5752ae0a712c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:18.525496 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9aa30504-7fa6-4b63-9139-5752ae0a712c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:18.526075 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9aa30504-7fa6-4b63-9139-5752ae0a712c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:18.526527 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9aa30504-7fa6-4b63-9139-5752ae0a712c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:18.527768 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9aa30504-7fa6-4b63-9139-5752ae0a712c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:18.528227 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9aa30504-7fa6-4b63-9139-5752ae0a712c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:18.528680 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9aa30504-7fa6-4b63-9139-5752ae0a712c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:18.577116 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7331425c-7b54-4542-b9ef-a534be609ce2 tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13" status: 200 len: 353 microversion: 2.1 time: 0.074751 Aug 19 15:30:18.577688 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 408/808] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Aug 19 15:30:18 2022] GET /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13 => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:30:18.590599 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-13c8af27-09f5-4e39-9e3c-e7dc9b25d41d tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] Calling method '.version_select at 0x7fb533284af0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:18.681869 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-13c8af27-09f5-4e39-9e3c-e7dc9b25d41d tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13" status: 200 len: 353 microversion: 2.1 time: 0.095380 Aug 19 15:30:18.682691 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 409/809] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Aug 19 15:30:18 2022] GET /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:30:18.691034 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a8e8b4bf-be10-4f45-80da-8b613133ec04 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:18.692325 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a8e8b4bf-be10-4f45-80da-8b613133ec04 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:18.704336 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9aa30504-7fa6-4b63-9139-5752ae0a712c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:18.708377 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8e8b4bf-be10-4f45-80da-8b613133ec04 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:18.708935 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8e8b4bf-be10-4f45-80da-8b613133ec04 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:18.709373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8e8b4bf-be10-4f45-80da-8b613133ec04 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:18.710114 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8e8b4bf-be10-4f45-80da-8b613133ec04 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:18.710565 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8e8b4bf-be10-4f45-80da-8b613133ec04 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:18.710988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8e8b4bf-be10-4f45-80da-8b613133ec04 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:18.716951 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9aa30504-7fa6-4b63-9139-5752ae0a712c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:18.718912 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9aa30504-7fa6-4b63-9139-5752ae0a712c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:18.720319 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9aa30504-7fa6-4b63-9139-5752ae0a712c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1722 microversion: 2.20 time: 0.207575 Aug 19 15:30:18.721397 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 401/810] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:18 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 15:30:18.728506 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3de04906-e862-4e6a-9283-5ecdc4c10f32 tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] Calling method '.version_select at 0x7fb5332cb5e0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:18.804288 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3de04906-e862-4e6a-9283-5ecdc4c10f32 tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13" status: 202 len: 0 microversion: 2.1 time: 0.081074 Aug 19 15:30:18.805058 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 402/811] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Aug 19 15:30:18 2022] DELETE /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:30:18.814337 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-88b3ada1-f598-45f4-8cc9-5c99e3dec578 tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] Calling method '.version_select at 0x7fb53336c8b0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:18.866137 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-a8e8b4bf-be10-4f45-80da-8b613133ec04 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lazy-loading 'services' on Instance uuid 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:30:18.907221 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-88b3ada1-f598-45f4-8cc9-5c99e3dec578 tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13" status: 200 len: 352 microversion: 2.1 time: 0.096968 Aug 19 15:30:18.907780 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 403/812] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Aug 19 15:30:18 2022] GET /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:30:18.995664 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a8e8b4bf-be10-4f45-80da-8b613133ec04 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "DELETE /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5/os-volume_attachments/3f3e8d25-2080-4042-a2a9-d57384f680c6" status: 202 len: 0 microversion: 2.1 time: 0.311493 Aug 19 15:30:19.000451 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 410/813] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Aug 19 15:30:18 2022] DELETE /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5/os-volume_attachments/3f3e8d25-2080-4042-a2a9-d57384f680c6 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:30:19.010926 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-31f32317-3c79-4bdf-99cc-eb4da8f6c843 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:19.014036 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-31f32317-3c79-4bdf-99cc-eb4da8f6c843 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:19.030298 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31f32317-3c79-4bdf-99cc-eb4da8f6c843 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:19.037122 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31f32317-3c79-4bdf-99cc-eb4da8f6c843 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:19.037573 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31f32317-3c79-4bdf-99cc-eb4da8f6c843 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:19.039097 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31f32317-3c79-4bdf-99cc-eb4da8f6c843 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:19.041058 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31f32317-3c79-4bdf-99cc-eb4da8f6c843 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:19.043389 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31f32317-3c79-4bdf-99cc-eb4da8f6c843 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:19.099736 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-31f32317-3c79-4bdf-99cc-eb4da8f6c843 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093633 Aug 19 15:30:19.100786 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 404/814] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:30:19 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:30:19.293913 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-008642f0-19d3-4031-abaa-2df47ecccd9b req-3361dac5-618c-4249-a7ab-6a6cf4284b06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc81caa-949a-42ac-b696-7bb7cb9c5fd5", "tag": "8e0d422a-3a6d-4e22-8237-a99f06f45464"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:30:19.303975 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-008642f0-19d3-4031-abaa-2df47ecccd9b req-3361dac5-618c-4249-a7ab-6a6cf4284b06 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:19.304491 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-008642f0-19d3-4031-abaa-2df47ecccd9b req-3361dac5-618c-4249-a7ab-6a6cf4284b06 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:19.304927 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-008642f0-19d3-4031-abaa-2df47ecccd9b req-3361dac5-618c-4249-a7ab-6a6cf4284b06 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:19.316075 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-008642f0-19d3-4031-abaa-2df47ecccd9b req-3361dac5-618c-4249-a7ab-6a6cf4284b06 service nova] Creating event network-changed:8e0d422a-3a6d-4e22-8237-a99f06f45464 for instance 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 on hv-cinder-83538 Aug 19 15:30:19.321401 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-008642f0-19d3-4031-abaa-2df47ecccd9b req-3361dac5-618c-4249-a7ab-6a6cf4284b06 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031585 Aug 19 15:30:19.321984 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 411/815] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:30:19.755732 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-89efbe73-6d03-4380-aae1-f9c90d16454a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:19.756430 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-89efbe73-6d03-4380-aae1-f9c90d16454a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:19.762891 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89efbe73-6d03-4380-aae1-f9c90d16454a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:19.763644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89efbe73-6d03-4380-aae1-f9c90d16454a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:19.764550 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89efbe73-6d03-4380-aae1-f9c90d16454a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:19.765350 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89efbe73-6d03-4380-aae1-f9c90d16454a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:19.765812 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89efbe73-6d03-4380-aae1-f9c90d16454a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:19.766235 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89efbe73-6d03-4380-aae1-f9c90d16454a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:19.923988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-11d3ba85-5d81-42dd-bb6c-e5d733248b04 tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] Calling method '.version_select at 0x7fb53327d310>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:19.924944 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-89efbe73-6d03-4380-aae1-f9c90d16454a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:19.934473 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-89efbe73-6d03-4380-aae1-f9c90d16454a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:19.936357 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-89efbe73-6d03-4380-aae1-f9c90d16454a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:19.937556 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-89efbe73-6d03-4380-aae1-f9c90d16454a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1722 microversion: 2.20 time: 0.185941 Aug 19 15:30:19.938108 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 405/816] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:19 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:19.952903 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-11d3ba85-5d81-42dd-bb6c-e5d733248b04 tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] HTTP exception thrown: Volume bcecee93-203b-4a32-8277-50fcb9e40c13 could not be found. Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-11d3ba85-5d81-42dd-bb6c-e5d733248b04 tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] Request method failure captured: Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13 HTTP/1.1 Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6yFFoQwpdUfwlb_oSQgUp2cIlq30H9_UVT6jpIFxHMoeNzgAV1pt-5w9yBHY535fyLvN-Sznn1oGJBqlPtVBwhv1NLbiGFs_8sZq9IBhJLg23CWmifc142au6nmYHOOTfKvqso_rIA7Bn_Dap61IBGI6nXRqt02DG2bFM6sa7Men78 Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: 213ae78186aa4ef582e8279302165d76 Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesGetTestJSON-1523550566 Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:30:19.955025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:30:19.956488 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_213ae78186aa4ef582e8279302165d76", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/213ae78186aa4ef582e8279302165d76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/213ae78186aa4ef582e8279302165d76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/213ae78186aa4ef582e8279302165d76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:30:19.956488 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesGetTestJSON-1523550566 Aug 19 15:30:19.956488 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 213ae78186aa4ef582e8279302165d76 Aug 19 15:30:19.956488 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesGetTestJSON-1523550566 Aug 19 15:30:19.956488 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesGetTestJSON-1523550566-project Aug 19 15:30:19.956488 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:30:19.956488 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:30:19.956488 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 28148ef7eeb94dbe9dcc11759e9daf50 Aug 19 15:30:19.956488 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesGetTestJSON-1523550566-project Aug 19 15:30:19.956488 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: Aug 19 15:30:19.956488 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Volume bcecee93-203b-4a32-8277-50fcb9e40c13 could not be found. Aug 19 15:30:19.956488 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': 'bcecee93-203b-4a32-8277-50fcb9e40c13'} Aug 19 15:30:19.956488 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bcecee93-203b-4a32-8277-50fcb9e40c13 could not be found. (HTTP 404) (Request-ID: req-73af749e-4f6f-48af-bc24-12a6783081f6) Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:19.957981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 15:30:19.959626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bcecee93-203b-4a32-8277-50fcb9e40c13 could not be found. Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 19 15:30:19.960870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:30:19.962029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bcecee93-203b-4a32-8277-50fcb9e40c13 could not be found. Aug 19 15:30:19.962029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:19.962029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:19.962029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:19.962029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:19.962029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:19.962029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:19.962029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:30:19.962029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:30:19.962029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bcecee93-203b-4a32-8277-50fcb9e40c13 could not be found. Aug 19 15:30:19.962029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:19.962029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-11d3ba85-5d81-42dd-bb6c-e5d733248b04 tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] Returning 404 to user: Volume bcecee93-203b-4a32-8277-50fcb9e40c13 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:30:19.962029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-11d3ba85-5d81-42dd-bb6c-e5d733248b04 tempest-VolumesGetTestJSON-1523550566 tempest-VolumesGetTestJSON-1523550566-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13" status: 404 len: 109 microversion: 2.1 time: 0.037761 Aug 19 15:30:19.962029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 412/817] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Aug 19 15:30:19 2022] GET /compute/v2.1/os-volumes/bcecee93-203b-4a32-8277-50fcb9e40c13 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:30:20.117193 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b95be153-09a6-4af9-9266-a931fa5d3985 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:20.119585 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b95be153-09a6-4af9-9266-a931fa5d3985 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:20.135695 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b95be153-09a6-4af9-9266-a931fa5d3985 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:20.136195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b95be153-09a6-4af9-9266-a931fa5d3985 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:20.136677 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b95be153-09a6-4af9-9266-a931fa5d3985 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:20.137466 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b95be153-09a6-4af9-9266-a931fa5d3985 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:20.137921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b95be153-09a6-4af9-9266-a931fa5d3985 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:20.138350 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b95be153-09a6-4af9-9266-a931fa5d3985 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:20.168163 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b95be153-09a6-4af9-9266-a931fa5d3985 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059794 Aug 19 15:30:20.169253 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 406/818] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Aug 19 15:30:20 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 15:30:20.180095 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f8d4fd64-55e8-41de-a829-62865c23c6bd tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:20.181063 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f8d4fd64-55e8-41de-a829-62865c23c6bd tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:20.189123 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8d4fd64-55e8-41de-a829-62865c23c6bd tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:20.189616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8d4fd64-55e8-41de-a829-62865c23c6bd tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:20.190061 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8d4fd64-55e8-41de-a829-62865c23c6bd tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:20.190926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8d4fd64-55e8-41de-a829-62865c23c6bd tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:20.192176 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8d4fd64-55e8-41de-a829-62865c23c6bd tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:20.192620 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8d4fd64-55e8-41de-a829-62865c23c6bd tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:20.276014 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-f8d4fd64-55e8-41de-a829-62865c23c6bd tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] HTTP exception thrown: Instance 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 is not attached to volume 3f3e8d25-2080-4042-a2a9-d57384f680c6 Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f8d4fd64-55e8-41de-a829-62865c23c6bd tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Request method failure captured: Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5/os-volume_attachments/3f3e8d25-2080-4042-a2a9-d57384f680c6 HTTP/1.1 Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6v8KCVOWCiXYZNaP8_LLRzEJE4UDLZrMOv4BV0q1pXKv_qZ2PSjLKfkS0uwV--TdJwNPr789cf9Wdcoo_zTi7tqpjc0nS1G-CC43bXJTsAd6gatI6Kg49ib7EoC5DiDtnv2McgCdbSMPRNUNnsW6sRVb3RF-g1XK1-oP1ndLxLqhEA Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: 3c3e603ab69848a2b9688f1e536017f3 Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-TestMinimumBasicScenario-1192748910 Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:30:20.278767 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:30:20.280223 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_3c3e603ab69848a2b9688f1e536017f3", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3c3e603ab69848a2b9688f1e536017f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3c3e603ab69848a2b9688f1e536017f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/3c3e603ab69848a2b9688f1e536017f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:30:20.280223 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-TestMinimumBasicScenario-1192748910 Aug 19 15:30:20.280223 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 3c3e603ab69848a2b9688f1e536017f3 Aug 19 15:30:20.280223 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1192748910 Aug 19 15:30:20.280223 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-TestMinimumBasicScenario-1192748910-project Aug 19 15:30:20.280223 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:30:20.280223 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:30:20.280223 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 48b7030c933c4e6a92711b35cd6f9685 Aug 19 15:30:20.280223 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-TestMinimumBasicScenario-1192748910-project Aug 19 15:30:20.280223 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:30:20.280223 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 is not attached to volume 3f3e8d25-2080-4042-a2a9-d57384f680c6 Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'server_id': '9bc81caa-949a-42ac-b696-7bb7cb9c5fd5', 'id': '3f3e8d25-2080-4042-a2a9-d57384f680c6'} Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3f3e8d25-2080-4042-a2a9-d57384f680c6. Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:30:20.281147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:30:20.283097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:30:20.283097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 19 15:30:20.283097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 19 15:30:20.283097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 is not attached to volume 3f3e8d25-2080-4042-a2a9-d57384f680c6 Aug 19 15:30:20.283097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:20.283097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:20.283097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:20.283097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:20.283097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:20.283097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:20.283097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:30:20.283097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:30:20.283097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 is not attached to volume 3f3e8d25-2080-4042-a2a9-d57384f680c6 Aug 19 15:30:20.283097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:20.283097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f8d4fd64-55e8-41de-a829-62865c23c6bd tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Returning 404 to user: Instance 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 is not attached to volume 3f3e8d25-2080-4042-a2a9-d57384f680c6 {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:30:20.284504 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f8d4fd64-55e8-41de-a829-62865c23c6bd tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "DELETE /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5/os-volume_attachments/3f3e8d25-2080-4042-a2a9-d57384f680c6" status: 404 len: 154 microversion: 2.1 time: 0.105021 Aug 19 15:30:20.285172 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 413/819] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Aug 19 15:30:20 2022] DELETE /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5/os-volume_attachments/3f3e8d25-2080-4042-a2a9-d57384f680c6 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:30:20.964745 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d4fa6d67-7db0-4d2a-8aca-b61ce91728f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:20.965455 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d4fa6d67-7db0-4d2a-8aca-b61ce91728f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:20.972094 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4fa6d67-7db0-4d2a-8aca-b61ce91728f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:20.972608 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4fa6d67-7db0-4d2a-8aca-b61ce91728f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:20.973587 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4fa6d67-7db0-4d2a-8aca-b61ce91728f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:20.974274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4fa6d67-7db0-4d2a-8aca-b61ce91728f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:20.974870 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4fa6d67-7db0-4d2a-8aca-b61ce91728f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:20.975301 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4fa6d67-7db0-4d2a-8aca-b61ce91728f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:20.991710 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:30:21.112268 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d4fa6d67-7db0-4d2a-8aca-b61ce91728f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:21.122760 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d4fa6d67-7db0-4d2a-8aca-b61ce91728f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:21.124733 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d4fa6d67-7db0-4d2a-8aca-b61ce91728f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:21.126135 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d4fa6d67-7db0-4d2a-8aca-b61ce91728f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1722 microversion: 2.20 time: 0.166299 Aug 19 15:30:21.126689 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 407/820] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:20 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:21.462207 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0830d731-136a-4bf2-ab78-e0a146ae1fa5 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:21.462950 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0830d731-136a-4bf2-ab78-e0a146ae1fa5 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:21.469570 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0830d731-136a-4bf2-ab78-e0a146ae1fa5 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:21.470165 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0830d731-136a-4bf2-ab78-e0a146ae1fa5 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:21.470602 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0830d731-136a-4bf2-ab78-e0a146ae1fa5 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:21.471322 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0830d731-136a-4bf2-ab78-e0a146ae1fa5 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:21.471771 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0830d731-136a-4bf2-ab78-e0a146ae1fa5 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:21.472189 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0830d731-136a-4bf2-ab78-e0a146ae1fa5 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:21.499725 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0830d731-136a-4bf2-ab78-e0a146ae1fa5 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:30:21.549841 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:30:21.586388 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0830d731-136a-4bf2-ab78-e0a146ae1fa5 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "DELETE /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 204 len: 0 microversion: 2.1 time: 0.128334 Aug 19 15:30:21.587493 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 414/821] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:30:21 2022] DELETE /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:30:21.598515 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2cdd60e1-9f4e-4a61-918b-2aff663f8fc3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:21.599359 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2cdd60e1-9f4e-4a61-918b-2aff663f8fc3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:21.605503 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cdd60e1-9f4e-4a61-918b-2aff663f8fc3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:21.605997 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cdd60e1-9f4e-4a61-918b-2aff663f8fc3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:21.606429 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cdd60e1-9f4e-4a61-918b-2aff663f8fc3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:21.607118 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cdd60e1-9f4e-4a61-918b-2aff663f8fc3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:21.607562 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cdd60e1-9f4e-4a61-918b-2aff663f8fc3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:21.608155 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cdd60e1-9f4e-4a61-918b-2aff663f8fc3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:21.749501 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2cdd60e1-9f4e-4a61-918b-2aff663f8fc3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:21.757762 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2cdd60e1-9f4e-4a61-918b-2aff663f8fc3 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1555 microversion: 2.1 time: 0.164219 Aug 19 15:30:21.758320 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 408/822] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:30:21 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:30:22.150917 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-333bcb5c-7dbc-4393-be33-3307a5f58a6c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:22.151564 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-333bcb5c-7dbc-4393-be33-3307a5f58a6c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:22.157721 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-333bcb5c-7dbc-4393-be33-3307a5f58a6c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:22.158204 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-333bcb5c-7dbc-4393-be33-3307a5f58a6c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:22.158643 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-333bcb5c-7dbc-4393-be33-3307a5f58a6c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:22.159340 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-333bcb5c-7dbc-4393-be33-3307a5f58a6c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:22.159840 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-333bcb5c-7dbc-4393-be33-3307a5f58a6c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:22.160266 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-333bcb5c-7dbc-4393-be33-3307a5f58a6c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:22.299705 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-333bcb5c-7dbc-4393-be33-3307a5f58a6c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:22.309420 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-333bcb5c-7dbc-4393-be33-3307a5f58a6c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:22.310931 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-333bcb5c-7dbc-4393-be33-3307a5f58a6c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:22.312089 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-333bcb5c-7dbc-4393-be33-3307a5f58a6c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1722 microversion: 2.20 time: 0.166882 Aug 19 15:30:22.312768 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 415/823] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:22 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:22.779463 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f8dad2d9-55aa-4118-b545-b0963e1c6808 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:22.780213 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f8dad2d9-55aa-4118-b545-b0963e1c6808 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:22.787512 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8dad2d9-55aa-4118-b545-b0963e1c6808 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:22.788009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8dad2d9-55aa-4118-b545-b0963e1c6808 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:22.788496 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8dad2d9-55aa-4118-b545-b0963e1c6808 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:22.789238 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8dad2d9-55aa-4118-b545-b0963e1c6808 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:22.789692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8dad2d9-55aa-4118-b545-b0963e1c6808 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:22.790117 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8dad2d9-55aa-4118-b545-b0963e1c6808 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:22.961591 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f8dad2d9-55aa-4118-b545-b0963e1c6808 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:22.969563 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f8dad2d9-55aa-4118-b545-b0963e1c6808 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1555 microversion: 2.1 time: 0.194136 Aug 19 15:30:22.970150 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 409/824] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:30:22 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1555 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:30:23.335261 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-99e9a17d-d5d4-4379-9090-2cadd3f77c7a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:23.335895 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-99e9a17d-d5d4-4379-9090-2cadd3f77c7a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:23.342346 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99e9a17d-d5d4-4379-9090-2cadd3f77c7a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:23.342832 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99e9a17d-d5d4-4379-9090-2cadd3f77c7a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:23.343262 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99e9a17d-d5d4-4379-9090-2cadd3f77c7a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:23.343956 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99e9a17d-d5d4-4379-9090-2cadd3f77c7a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:23.344447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99e9a17d-d5d4-4379-9090-2cadd3f77c7a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:23.344874 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99e9a17d-d5d4-4379-9090-2cadd3f77c7a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:23.541891 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-99e9a17d-d5d4-4379-9090-2cadd3f77c7a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:23.551285 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-99e9a17d-d5d4-4379-9090-2cadd3f77c7a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:23.553046 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-99e9a17d-d5d4-4379-9090-2cadd3f77c7a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:23.554327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-99e9a17d-d5d4-4379-9090-2cadd3f77c7a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1722 microversion: 2.20 time: 0.223014 Aug 19 15:30:23.554966 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 416/825] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:23 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:23.991566 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6a8cda7b-e3d6-4e65-bce5-6e0657a4ab6c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:23.992168 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6a8cda7b-e3d6-4e65-bce5-6e0657a4ab6c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:23.998633 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a8cda7b-e3d6-4e65-bce5-6e0657a4ab6c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:23.999107 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a8cda7b-e3d6-4e65-bce5-6e0657a4ab6c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:23.999532 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a8cda7b-e3d6-4e65-bce5-6e0657a4ab6c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:24.000263 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a8cda7b-e3d6-4e65-bce5-6e0657a4ab6c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:24.000778 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a8cda7b-e3d6-4e65-bce5-6e0657a4ab6c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:24.001252 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a8cda7b-e3d6-4e65-bce5-6e0657a4ab6c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:24.138430 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6a8cda7b-e3d6-4e65-bce5-6e0657a4ab6c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:24.146718 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6a8cda7b-e3d6-4e65-bce5-6e0657a4ab6c tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1555 microversion: 2.1 time: 0.159794 Aug 19 15:30:24.147367 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 410/826] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:30:23 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:30:24.577846 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f640742e-dfc5-42af-9074-bd9792cff414 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:24.578450 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f640742e-dfc5-42af-9074-bd9792cff414 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:24.585922 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f640742e-dfc5-42af-9074-bd9792cff414 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:24.586349 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f640742e-dfc5-42af-9074-bd9792cff414 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:24.586973 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f640742e-dfc5-42af-9074-bd9792cff414 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:24.587683 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f640742e-dfc5-42af-9074-bd9792cff414 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:24.588138 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f640742e-dfc5-42af-9074-bd9792cff414 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:24.588595 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f640742e-dfc5-42af-9074-bd9792cff414 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:24.728919 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f640742e-dfc5-42af-9074-bd9792cff414 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:24.738201 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f640742e-dfc5-42af-9074-bd9792cff414 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:24.739766 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f640742e-dfc5-42af-9074-bd9792cff414 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:24.740951 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f640742e-dfc5-42af-9074-bd9792cff414 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1722 microversion: 2.20 time: 0.167066 Aug 19 15:30:24.741500 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 417/827] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:24 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:25.169497 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0bba8411-5b15-4ebf-8b61-e180b93feb06 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:25.170098 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0bba8411-5b15-4ebf-8b61-e180b93feb06 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:25.177465 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bba8411-5b15-4ebf-8b61-e180b93feb06 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:25.177942 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bba8411-5b15-4ebf-8b61-e180b93feb06 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:25.178363 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bba8411-5b15-4ebf-8b61-e180b93feb06 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:25.179038 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bba8411-5b15-4ebf-8b61-e180b93feb06 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:25.179479 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bba8411-5b15-4ebf-8b61-e180b93feb06 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:25.179891 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bba8411-5b15-4ebf-8b61-e180b93feb06 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:25.313770 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0bba8411-5b15-4ebf-8b61-e180b93feb06 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:25.322201 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0bba8411-5b15-4ebf-8b61-e180b93feb06 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1555 microversion: 2.1 time: 0.156451 Aug 19 15:30:25.323333 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 411/828] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:30:25 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:30:25.763068 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b4ccc7cc-2b93-4fe9-9c8d-2a4f91ad3c4b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:25.763671 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b4ccc7cc-2b93-4fe9-9c8d-2a4f91ad3c4b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:25.771221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4ccc7cc-2b93-4fe9-9c8d-2a4f91ad3c4b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:25.771770 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4ccc7cc-2b93-4fe9-9c8d-2a4f91ad3c4b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:25.772202 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4ccc7cc-2b93-4fe9-9c8d-2a4f91ad3c4b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:25.772923 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4ccc7cc-2b93-4fe9-9c8d-2a4f91ad3c4b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:25.773376 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4ccc7cc-2b93-4fe9-9c8d-2a4f91ad3c4b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:25.773798 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b4ccc7cc-2b93-4fe9-9c8d-2a4f91ad3c4b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:25.907331 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b4ccc7cc-2b93-4fe9-9c8d-2a4f91ad3c4b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:25.916413 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b4ccc7cc-2b93-4fe9-9c8d-2a4f91ad3c4b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:25.917939 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b4ccc7cc-2b93-4fe9-9c8d-2a4f91ad3c4b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:25.919119 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b4ccc7cc-2b93-4fe9-9c8d-2a4f91ad3c4b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1743 microversion: 2.20 time: 0.159990 Aug 19 15:30:25.919666 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 418/829] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:25 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:26.085661 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-49209ea7-3f2b-4eb3-a422-9d67ae458aed req-7031e6dd-a65a-4d1d-8ba9-7ec2c33e3501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc81caa-949a-42ac-b696-7bb7cb9c5fd5", "name": "network-vif-deleted", "tag": "8e0d422a-3a6d-4e22-8237-a99f06f45464"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:30:26.095836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-49209ea7-3f2b-4eb3-a422-9d67ae458aed req-7031e6dd-a65a-4d1d-8ba9-7ec2c33e3501 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:26.096313 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-49209ea7-3f2b-4eb3-a422-9d67ae458aed req-7031e6dd-a65a-4d1d-8ba9-7ec2c33e3501 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:26.096769 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-49209ea7-3f2b-4eb3-a422-9d67ae458aed req-7031e6dd-a65a-4d1d-8ba9-7ec2c33e3501 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:26.110044 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-49209ea7-3f2b-4eb3-a422-9d67ae458aed req-7031e6dd-a65a-4d1d-8ba9-7ec2c33e3501 service nova] Creating event network-vif-deleted:8e0d422a-3a6d-4e22-8237-a99f06f45464 for instance 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 on hv-cinder-83538 Aug 19 15:30:26.116635 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-49209ea7-3f2b-4eb3-a422-9d67ae458aed req-7031e6dd-a65a-4d1d-8ba9-7ec2c33e3501 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034668 Aug 19 15:30:26.117439 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 412/830] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:30:26.343418 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-432bcbe9-b080-4a91-a895-8c4dcc0611fc tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:26.344023 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-432bcbe9-b080-4a91-a895-8c4dcc0611fc tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:26.350766 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-432bcbe9-b080-4a91-a895-8c4dcc0611fc tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:26.351486 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-432bcbe9-b080-4a91-a895-8c4dcc0611fc tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:26.351611 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-432bcbe9-b080-4a91-a895-8c4dcc0611fc tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:26.352254 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-432bcbe9-b080-4a91-a895-8c4dcc0611fc tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:26.352728 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-432bcbe9-b080-4a91-a895-8c4dcc0611fc tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:26.353363 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-432bcbe9-b080-4a91-a895-8c4dcc0611fc tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:26.390605 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-432bcbe9-b080-4a91-a895-8c4dcc0611fc tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:26.391086 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-432bcbe9-b080-4a91-a895-8c4dcc0611fc tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:26.391516 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-432bcbe9-b080-4a91-a895-8c4dcc0611fc tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:26.392051 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-432bcbe9-b080-4a91-a895-8c4dcc0611fc tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lazy-loading 'fault' on Instance uuid 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:30:26.447126 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-432bcbe9-b080-4a91-a895-8c4dcc0611fc tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b7030c933c4e6a92711b35cd6f9685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3e603ab69848a2b9688f1e536017f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:26.457948 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-432bcbe9-b080-4a91-a895-8c4dcc0611fc tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 200 len: 1348 microversion: 2.1 time: 0.117785 Aug 19 15:30:26.462853 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 419/831] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:30:26 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 1348 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:30:26.945790 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9f412d52-3cab-412d-9377-4b7acacf2a09 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:26.946551 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9f412d52-3cab-412d-9377-4b7acacf2a09 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:26.952950 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f412d52-3cab-412d-9377-4b7acacf2a09 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:26.953506 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f412d52-3cab-412d-9377-4b7acacf2a09 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:26.953946 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f412d52-3cab-412d-9377-4b7acacf2a09 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:26.954670 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f412d52-3cab-412d-9377-4b7acacf2a09 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:26.955193 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f412d52-3cab-412d-9377-4b7acacf2a09 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:26.955606 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f412d52-3cab-412d-9377-4b7acacf2a09 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:27.092699 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f412d52-3cab-412d-9377-4b7acacf2a09 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:27.101114 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f412d52-3cab-412d-9377-4b7acacf2a09 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:27.102615 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f412d52-3cab-412d-9377-4b7acacf2a09 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:27.104163 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9f412d52-3cab-412d-9377-4b7acacf2a09 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1743 microversion: 2.20 time: 0.164364 Aug 19 15:30:27.104313 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 413/832] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:26 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:27.482148 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d94d5d1e-7766-4f2b-91e5-38b81edeec63 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:27.482757 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d94d5d1e-7766-4f2b-91e5-38b81edeec63 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] [instance: 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:27.489690 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d94d5d1e-7766-4f2b-91e5-38b81edeec63 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:27.490172 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d94d5d1e-7766-4f2b-91e5-38b81edeec63 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:27.490608 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d94d5d1e-7766-4f2b-91e5-38b81edeec63 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:27.491355 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d94d5d1e-7766-4f2b-91e5-38b81edeec63 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:27.491827 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d94d5d1e-7766-4f2b-91e5-38b81edeec63 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:27.492292 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d94d5d1e-7766-4f2b-91e5-38b81edeec63 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:27.506304 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-d94d5d1e-7766-4f2b-91e5-38b81edeec63 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] HTTP exception thrown: Instance 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 could not be found. Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d94d5d1e-7766-4f2b-91e5-38b81edeec63 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Request method failure captured: Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 HTTP/1.1 Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6v8KCVOWCiXYZNaP8_LLRzEJE4UDLZrMOv4BV0q1pXKv_qZ2PSjLKfkS0uwV--TdJwNPr789cf9Wdcoo_zTi7tqpjc0nS1G-CC43bXJTsAd6gatI6Kg49ib7EoC5DiDtnv2McgCdbSMPRNUNnsW6sRVb3RF-g1XK1-oP1ndLxLqhEA Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: 3c3e603ab69848a2b9688f1e536017f3 Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-TestMinimumBasicScenario-1192748910 Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:30:27.507894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:30:27.509646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_3c3e603ab69848a2b9688f1e536017f3", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3c3e603ab69848a2b9688f1e536017f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3c3e603ab69848a2b9688f1e536017f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/3c3e603ab69848a2b9688f1e536017f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:30:27.509646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-TestMinimumBasicScenario-1192748910 Aug 19 15:30:27.509646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 3c3e603ab69848a2b9688f1e536017f3 Aug 19 15:30:27.509646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1192748910 Aug 19 15:30:27.509646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-TestMinimumBasicScenario-1192748910-project Aug 19 15:30:27.509646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:30:27.509646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:30:27.509646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 48b7030c933c4e6a92711b35cd6f9685 Aug 19 15:30:27.509646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-TestMinimumBasicScenario-1192748910-project Aug 19 15:30:27.509646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:30:27.509646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 could not be found. Aug 19 15:30:27.509646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': '9bc81caa-949a-42ac-b696-7bb7cb9c5fd5'} Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 could not be found. Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:30:27.510616 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:30:27.512091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:30:27.512091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:30:27.512091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:30:27.512091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:30:27.512091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:30:27.512091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:30:27.512091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:30:27.512091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 could not be found. Aug 19 15:30:27.512091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:27.512091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:30:27.512091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:27.512091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:30:27.512091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:30:27.512091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:30:27.512091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:30:27.512091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:30:27.512091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 could not be found. Aug 19 15:30:27.512091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:30:27.513548 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d94d5d1e-7766-4f2b-91e5-38b81edeec63 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Returning 404 to user: Instance 9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:30:27.513548 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d94d5d1e-7766-4f2b-91e5-38b81edeec63 tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5" status: 404 len: 111 microversion: 2.1 time: 0.031018 Aug 19 15:30:27.513548 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 420/833] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:30:27 2022] GET /compute/v2.1/servers/9bc81caa-949a-42ac-b696-7bb7cb9c5fd5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:30:27.519337 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0ef09c2b-f4cd-4ac5-a404-3e86ab7e7dba tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] Calling method '.version_select at 0x7fb53332adc0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:27.538223 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0ef09c2b-f4cd-4ac5-a404-3e86ab7e7dba tempest-TestMinimumBasicScenario-1192748910 tempest-TestMinimumBasicScenario-1192748910-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1851561349" status: 202 len: 0 microversion: 2.1 time: 0.023776 Aug 19 15:30:27.538784 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 414/834] 10.222.0.75 () {58 vars in 1272 bytes} [Fri Aug 19 15:30:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1851561349 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:30:28.132977 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-47eeb7ba-63d3-4203-bb34-63021abdf96b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:28.133636 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-47eeb7ba-63d3-4203-bb34-63021abdf96b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:28.141631 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47eeb7ba-63d3-4203-bb34-63021abdf96b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:28.142307 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47eeb7ba-63d3-4203-bb34-63021abdf96b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:28.142933 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47eeb7ba-63d3-4203-bb34-63021abdf96b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:28.143793 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47eeb7ba-63d3-4203-bb34-63021abdf96b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:28.144448 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47eeb7ba-63d3-4203-bb34-63021abdf96b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:28.145216 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47eeb7ba-63d3-4203-bb34-63021abdf96b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:28.386909 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-47eeb7ba-63d3-4203-bb34-63021abdf96b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:28.415026 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-47eeb7ba-63d3-4203-bb34-63021abdf96b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:28.422457 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-47eeb7ba-63d3-4203-bb34-63021abdf96b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:28.424882 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-47eeb7ba-63d3-4203-bb34-63021abdf96b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1738 microversion: 2.20 time: 0.299842 Aug 19 15:30:28.429215 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 421/835] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:28 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1738 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 15:30:28.796692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-1d017067-78bd-4678-846f-24489c2d6b4e req-a69877d3-3899-408a-a5bf-93bceacf74e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b2c2fe-ead2-4d92-b4fb-dc42b41094fd", "name": "network-vif-plugged", "status": "completed", "tag": "5bf9b7d8-d705-4190-bd01-29213ebc351a"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:30:28.826604 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1d017067-78bd-4678-846f-24489c2d6b4e req-a69877d3-3899-408a-a5bf-93bceacf74e2 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:28.827094 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1d017067-78bd-4678-846f-24489c2d6b4e req-a69877d3-3899-408a-a5bf-93bceacf74e2 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:28.829691 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1d017067-78bd-4678-846f-24489c2d6b4e req-a69877d3-3899-408a-a5bf-93bceacf74e2 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:28.857761 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-1d017067-78bd-4678-846f-24489c2d6b4e req-a69877d3-3899-408a-a5bf-93bceacf74e2 service nova] Creating event network-vif-plugged:5bf9b7d8-d705-4190-bd01-29213ebc351a for instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd on hv-cinder-83538 Aug 19 15:30:28.869173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-1d017067-78bd-4678-846f-24489c2d6b4e req-a69877d3-3899-408a-a5bf-93bceacf74e2 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078204 Aug 19 15:30:28.872662 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 415/836] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:30:29.463313 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e75690b5-5a45-4239-b050-c82468306f50 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:29.464617 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e75690b5-5a45-4239-b050-c82468306f50 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:29.478217 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e75690b5-5a45-4239-b050-c82468306f50 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:29.483049 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e75690b5-5a45-4239-b050-c82468306f50 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:29.485330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e75690b5-5a45-4239-b050-c82468306f50 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:29.486390 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e75690b5-5a45-4239-b050-c82468306f50 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:29.488089 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e75690b5-5a45-4239-b050-c82468306f50 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:29.492711 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e75690b5-5a45-4239-b050-c82468306f50 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:29.714586 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e75690b5-5a45-4239-b050-c82468306f50 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:29.730297 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e75690b5-5a45-4239-b050-c82468306f50 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:29.733633 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e75690b5-5a45-4239-b050-c82468306f50 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:29.736807 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e75690b5-5a45-4239-b050-c82468306f50 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1738 microversion: 2.20 time: 0.279729 Aug 19 15:30:29.741274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 422/837] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:29 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1738 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:30.764351 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6188e012-0fe5-4f56-abec-a2b9f2faa3aa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:30.770036 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6188e012-0fe5-4f56-abec-a2b9f2faa3aa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:30.787255 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6188e012-0fe5-4f56-abec-a2b9f2faa3aa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:30.787751 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6188e012-0fe5-4f56-abec-a2b9f2faa3aa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:30.788184 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6188e012-0fe5-4f56-abec-a2b9f2faa3aa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:30.791138 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6188e012-0fe5-4f56-abec-a2b9f2faa3aa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:30.791587 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6188e012-0fe5-4f56-abec-a2b9f2faa3aa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:30.792019 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6188e012-0fe5-4f56-abec-a2b9f2faa3aa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:31.130460 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6188e012-0fe5-4f56-abec-a2b9f2faa3aa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:31.172638 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6188e012-0fe5-4f56-abec-a2b9f2faa3aa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:31.176797 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6188e012-0fe5-4f56-abec-a2b9f2faa3aa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:31.180538 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6188e012-0fe5-4f56-abec-a2b9f2faa3aa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1738 microversion: 2.20 time: 0.419751 Aug 19 15:30:31.183216 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 416/838] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:30 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1738 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:32.205651 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9b119bab-4027-4896-bb50-9152323d25a0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:32.207047 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9b119bab-4027-4896-bb50-9152323d25a0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:32.221561 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b119bab-4027-4896-bb50-9152323d25a0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:32.222311 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b119bab-4027-4896-bb50-9152323d25a0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:32.223102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b119bab-4027-4896-bb50-9152323d25a0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:32.225354 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b119bab-4027-4896-bb50-9152323d25a0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:32.225983 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b119bab-4027-4896-bb50-9152323d25a0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:32.226565 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b119bab-4027-4896-bb50-9152323d25a0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:32.512354 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9b119bab-4027-4896-bb50-9152323d25a0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:32.522716 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9b119bab-4027-4896-bb50-9152323d25a0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:32.524643 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9b119bab-4027-4896-bb50-9152323d25a0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:32.526009 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9b119bab-4027-4896-bb50-9152323d25a0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1738 microversion: 2.20 time: 0.324302 Aug 19 15:30:32.528341 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 423/839] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:32 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1738 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:33.550535 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4e3dfc00-c9aa-4223-a5b8-5fc7296a8d18 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:33.552668 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4e3dfc00-c9aa-4223-a5b8-5fc7296a8d18 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:33.563048 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e3dfc00-c9aa-4223-a5b8-5fc7296a8d18 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:33.563536 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e3dfc00-c9aa-4223-a5b8-5fc7296a8d18 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:33.577101 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e3dfc00-c9aa-4223-a5b8-5fc7296a8d18 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:33.578172 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e3dfc00-c9aa-4223-a5b8-5fc7296a8d18 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:33.578626 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e3dfc00-c9aa-4223-a5b8-5fc7296a8d18 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:33.579054 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e3dfc00-c9aa-4223-a5b8-5fc7296a8d18 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:33.909620 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4e3dfc00-c9aa-4223-a5b8-5fc7296a8d18 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:33.939320 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4e3dfc00-c9aa-4223-a5b8-5fc7296a8d18 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:33.942813 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4e3dfc00-c9aa-4223-a5b8-5fc7296a8d18 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:33.944825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4e3dfc00-c9aa-4223-a5b8-5fc7296a8d18 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1738 microversion: 2.20 time: 0.398403 Aug 19 15:30:33.946365 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 417/840] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:33 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1738 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:34.969082 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1e8ba6f9-f69f-4845-98fb-f10d7c20d32e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:34.969752 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1e8ba6f9-f69f-4845-98fb-f10d7c20d32e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:34.978970 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e8ba6f9-f69f-4845-98fb-f10d7c20d32e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:34.979745 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e8ba6f9-f69f-4845-98fb-f10d7c20d32e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:34.980470 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e8ba6f9-f69f-4845-98fb-f10d7c20d32e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:34.982405 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e8ba6f9-f69f-4845-98fb-f10d7c20d32e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:34.983039 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e8ba6f9-f69f-4845-98fb-f10d7c20d32e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:34.983647 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e8ba6f9-f69f-4845-98fb-f10d7c20d32e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:35.190958 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1e8ba6f9-f69f-4845-98fb-f10d7c20d32e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:35.205052 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1e8ba6f9-f69f-4845-98fb-f10d7c20d32e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:35.207563 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1e8ba6f9-f69f-4845-98fb-f10d7c20d32e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:35.209189 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1e8ba6f9-f69f-4845-98fb-f10d7c20d32e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1738 microversion: 2.20 time: 0.245376 Aug 19 15:30:35.210652 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 424/841] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:34 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1738 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:36.244816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-67a2c72f-dbea-43d2-9aee-aae0806dfadf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:36.248598 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-67a2c72f-dbea-43d2-9aee-aae0806dfadf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:36.264174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67a2c72f-dbea-43d2-9aee-aae0806dfadf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:36.266410 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67a2c72f-dbea-43d2-9aee-aae0806dfadf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:36.267603 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67a2c72f-dbea-43d2-9aee-aae0806dfadf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:36.271493 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67a2c72f-dbea-43d2-9aee-aae0806dfadf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:36.272077 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67a2c72f-dbea-43d2-9aee-aae0806dfadf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:36.272615 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67a2c72f-dbea-43d2-9aee-aae0806dfadf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:36.569521 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-67a2c72f-dbea-43d2-9aee-aae0806dfadf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:36.594935 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-67a2c72f-dbea-43d2-9aee-aae0806dfadf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:36.596754 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-67a2c72f-dbea-43d2-9aee-aae0806dfadf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:36.598736 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-67a2c72f-dbea-43d2-9aee-aae0806dfadf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1738 microversion: 2.20 time: 0.363879 Aug 19 15:30:36.599719 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 418/842] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:36 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1738 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:37.634085 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-92451267-de67-451b-9866-9db68d113cf3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:37.634801 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-92451267-de67-451b-9866-9db68d113cf3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:37.651367 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92451267-de67-451b-9866-9db68d113cf3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:37.652302 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92451267-de67-451b-9866-9db68d113cf3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:37.652949 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92451267-de67-451b-9866-9db68d113cf3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:37.653834 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92451267-de67-451b-9866-9db68d113cf3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:37.654622 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92451267-de67-451b-9866-9db68d113cf3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:37.655327 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92451267-de67-451b-9866-9db68d113cf3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:37.914237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-92451267-de67-451b-9866-9db68d113cf3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:37.937881 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-92451267-de67-451b-9866-9db68d113cf3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:37.945670 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-92451267-de67-451b-9866-9db68d113cf3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:37.948310 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-92451267-de67-451b-9866-9db68d113cf3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1738 microversion: 2.20 time: 0.324109 Aug 19 15:30:37.954023 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 425/843] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:37 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1738 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:38.978223 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c62699e6-0862-475c-9da2-0ea12c133a2c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:38.979559 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c62699e6-0862-475c-9da2-0ea12c133a2c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:39.006175 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c62699e6-0862-475c-9da2-0ea12c133a2c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:39.007800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c62699e6-0862-475c-9da2-0ea12c133a2c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:39.008896 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c62699e6-0862-475c-9da2-0ea12c133a2c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:39.010653 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c62699e6-0862-475c-9da2-0ea12c133a2c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:39.012927 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c62699e6-0862-475c-9da2-0ea12c133a2c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:39.013680 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c62699e6-0862-475c-9da2-0ea12c133a2c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:39.345740 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c62699e6-0862-475c-9da2-0ea12c133a2c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:39.388228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c62699e6-0862-475c-9da2-0ea12c133a2c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:39.397703 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c62699e6-0862-475c-9da2-0ea12c133a2c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:39.399387 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c62699e6-0862-475c-9da2-0ea12c133a2c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1738 microversion: 2.20 time: 0.427528 Aug 19 15:30:39.404195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 419/844] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:38 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1738 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:40.428424 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3d139230-0a1e-4a60-9468-62d942e40fba tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:40.429584 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3d139230-0a1e-4a60-9468-62d942e40fba tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:40.441757 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d139230-0a1e-4a60-9468-62d942e40fba tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:40.445217 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d139230-0a1e-4a60-9468-62d942e40fba tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:40.447159 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d139230-0a1e-4a60-9468-62d942e40fba tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:40.449264 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d139230-0a1e-4a60-9468-62d942e40fba tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:40.455492 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d139230-0a1e-4a60-9468-62d942e40fba tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:40.456862 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d139230-0a1e-4a60-9468-62d942e40fba tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:40.979482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3d139230-0a1e-4a60-9468-62d942e40fba tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:40.988281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3d139230-0a1e-4a60-9468-62d942e40fba tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:40.998790 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3d139230-0a1e-4a60-9468-62d942e40fba tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:41.000504 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3d139230-0a1e-4a60-9468-62d942e40fba tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1738 microversion: 2.20 time: 0.578501 Aug 19 15:30:41.001654 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 426/845] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:40 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1738 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:42.030954 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-172b7301-1ffd-4024-9c1a-ffee59e53ef8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:42.031563 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-172b7301-1ffd-4024-9c1a-ffee59e53ef8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:42.042640 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-172b7301-1ffd-4024-9c1a-ffee59e53ef8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:42.043128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-172b7301-1ffd-4024-9c1a-ffee59e53ef8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:42.047969 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-172b7301-1ffd-4024-9c1a-ffee59e53ef8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:42.055310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-172b7301-1ffd-4024-9c1a-ffee59e53ef8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:42.056615 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-172b7301-1ffd-4024-9c1a-ffee59e53ef8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:42.058598 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-172b7301-1ffd-4024-9c1a-ffee59e53ef8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:42.307629 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-172b7301-1ffd-4024-9c1a-ffee59e53ef8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:42.319988 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-172b7301-1ffd-4024-9c1a-ffee59e53ef8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:42.322073 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-172b7301-1ffd-4024-9c1a-ffee59e53ef8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:42.323934 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-172b7301-1ffd-4024-9c1a-ffee59e53ef8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1738 microversion: 2.20 time: 0.298266 Aug 19 15:30:42.336421 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 420/846] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:42 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1738 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:43.354963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-be102764-ccf3-489a-bfb3-08edbf687d84 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:43.355634 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-be102764-ccf3-489a-bfb3-08edbf687d84 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:43.369205 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be102764-ccf3-489a-bfb3-08edbf687d84 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:43.370467 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be102764-ccf3-489a-bfb3-08edbf687d84 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:43.371304 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be102764-ccf3-489a-bfb3-08edbf687d84 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:43.372254 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be102764-ccf3-489a-bfb3-08edbf687d84 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:43.372949 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be102764-ccf3-489a-bfb3-08edbf687d84 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:43.373634 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be102764-ccf3-489a-bfb3-08edbf687d84 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:43.577907 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-be102764-ccf3-489a-bfb3-08edbf687d84 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:43.590893 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-be102764-ccf3-489a-bfb3-08edbf687d84 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:43.595885 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-be102764-ccf3-489a-bfb3-08edbf687d84 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:43.597181 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-be102764-ccf3-489a-bfb3-08edbf687d84 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1738 microversion: 2.20 time: 0.252932 Aug 19 15:30:43.597797 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 427/847] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:43 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:44.619837 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-afb82197-e08a-4109-8caa-ed386cf8a8f4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:44.620582 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-afb82197-e08a-4109-8caa-ed386cf8a8f4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:44.627154 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afb82197-e08a-4109-8caa-ed386cf8a8f4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:44.627638 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afb82197-e08a-4109-8caa-ed386cf8a8f4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:44.628076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afb82197-e08a-4109-8caa-ed386cf8a8f4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:44.628790 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afb82197-e08a-4109-8caa-ed386cf8a8f4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:44.629273 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afb82197-e08a-4109-8caa-ed386cf8a8f4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:44.629672 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afb82197-e08a-4109-8caa-ed386cf8a8f4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:44.767195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-afb82197-e08a-4109-8caa-ed386cf8a8f4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:44.775617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-afb82197-e08a-4109-8caa-ed386cf8a8f4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:44.777158 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-afb82197-e08a-4109-8caa-ed386cf8a8f4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:44.778320 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-afb82197-e08a-4109-8caa-ed386cf8a8f4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1738 microversion: 2.20 time: 0.162563 Aug 19 15:30:44.778870 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 421/848] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:44 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:45.800091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1677759a-e799-4698-8953-abdf9c6e573b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:45.800863 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1677759a-e799-4698-8953-abdf9c6e573b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:45.807170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:30:45.809417 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1677759a-e799-4698-8953-abdf9c6e573b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:45.809979 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1677759a-e799-4698-8953-abdf9c6e573b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:45.810416 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1677759a-e799-4698-8953-abdf9c6e573b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:45.811301 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1677759a-e799-4698-8953-abdf9c6e573b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:45.811912 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1677759a-e799-4698-8953-abdf9c6e573b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:45.812538 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1677759a-e799-4698-8953-abdf9c6e573b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:45.963333 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1677759a-e799-4698-8953-abdf9c6e573b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:45.976705 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1677759a-e799-4698-8953-abdf9c6e573b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:45.978653 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1677759a-e799-4698-8953-abdf9c6e573b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:45.980741 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1677759a-e799-4698-8953-abdf9c6e573b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1720 microversion: 2.20 time: 0.183982 Aug 19 15:30:45.981566 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 428/849] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:45 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:47.004973 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6495b301-c03f-4b74-ac8e-0e6e77c3bbd5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:47.005579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6495b301-c03f-4b74-ac8e-0e6e77c3bbd5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:47.011976 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6495b301-c03f-4b74-ac8e-0e6e77c3bbd5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:47.012493 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6495b301-c03f-4b74-ac8e-0e6e77c3bbd5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:47.012930 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6495b301-c03f-4b74-ac8e-0e6e77c3bbd5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:47.013614 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6495b301-c03f-4b74-ac8e-0e6e77c3bbd5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:47.014067 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6495b301-c03f-4b74-ac8e-0e6e77c3bbd5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:47.014486 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6495b301-c03f-4b74-ac8e-0e6e77c3bbd5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:47.145858 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6495b301-c03f-4b74-ac8e-0e6e77c3bbd5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:47.154033 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6495b301-c03f-4b74-ac8e-0e6e77c3bbd5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:47.155543 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6495b301-c03f-4b74-ac8e-0e6e77c3bbd5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:47.156773 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6495b301-c03f-4b74-ac8e-0e6e77c3bbd5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1720 microversion: 2.20 time: 0.155910 Aug 19 15:30:47.157328 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 422/850] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:46 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 15:30:48.180868 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eb9a96cb-2e55-488b-b8e2-f782c4692afe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:48.181517 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eb9a96cb-2e55-488b-b8e2-f782c4692afe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:48.188037 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb9a96cb-2e55-488b-b8e2-f782c4692afe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:48.188557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb9a96cb-2e55-488b-b8e2-f782c4692afe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:48.189006 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb9a96cb-2e55-488b-b8e2-f782c4692afe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:48.189677 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb9a96cb-2e55-488b-b8e2-f782c4692afe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:48.190148 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb9a96cb-2e55-488b-b8e2-f782c4692afe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:48.190569 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb9a96cb-2e55-488b-b8e2-f782c4692afe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:48.577229 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eb9a96cb-2e55-488b-b8e2-f782c4692afe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:48.590455 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eb9a96cb-2e55-488b-b8e2-f782c4692afe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:48.591920 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eb9a96cb-2e55-488b-b8e2-f782c4692afe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:48.593114 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eb9a96cb-2e55-488b-b8e2-f782c4692afe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1720 microversion: 2.20 time: 0.416941 Aug 19 15:30:48.593987 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 429/851] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:48 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1720 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:49.616430 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2775671f-aa10-4edf-9d07-1116fb3cf76c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:49.617079 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2775671f-aa10-4edf-9d07-1116fb3cf76c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:49.619473 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:30:49.624849 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2775671f-aa10-4edf-9d07-1116fb3cf76c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:49.625362 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2775671f-aa10-4edf-9d07-1116fb3cf76c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:49.625791 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2775671f-aa10-4edf-9d07-1116fb3cf76c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:49.626488 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2775671f-aa10-4edf-9d07-1116fb3cf76c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:49.626937 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2775671f-aa10-4edf-9d07-1116fb3cf76c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:49.627360 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2775671f-aa10-4edf-9d07-1116fb3cf76c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:49.792806 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2775671f-aa10-4edf-9d07-1116fb3cf76c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:49.802231 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2775671f-aa10-4edf-9d07-1116fb3cf76c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:49.803965 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2775671f-aa10-4edf-9d07-1116fb3cf76c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:49.805167 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2775671f-aa10-4edf-9d07-1116fb3cf76c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1663 microversion: 2.20 time: 0.192805 Aug 19 15:30:49.805788 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 423/852] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:49 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1663 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:49.829991 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ddaf8649-db3c-4851-90e6-ce8a5ec05621 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fcccedc-0f73-40db-903b-d79eef0b8c74"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:30:49.832721 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ddaf8649-db3c-4851-90e6-ce8a5ec05621 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:49.839258 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddaf8649-db3c-4851-90e6-ce8a5ec05621 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:49.839751 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddaf8649-db3c-4851-90e6-ce8a5ec05621 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:49.840188 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddaf8649-db3c-4851-90e6-ce8a5ec05621 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:49.840917 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddaf8649-db3c-4851-90e6-ce8a5ec05621 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:49.841370 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddaf8649-db3c-4851-90e6-ce8a5ec05621 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:49.841794 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddaf8649-db3c-4851-90e6-ce8a5ec05621 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:50.023401 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:30:50.150439 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ddaf8649-db3c-4851-90e6-ce8a5ec05621 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "POST /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.324998 Aug 19 15:30:50.151076 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 430/853] 10.222.0.75 () {62 vars in 1364 bytes} [Fri Aug 19 15:30:49 2022] POST /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 15:30:50.277301 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d48a7a03-f75e-4363-8a6b-edff0cb85579 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:30:50.277962 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d48a7a03-f75e-4363-8a6b-edff0cb85579 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:50.283905 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d48a7a03-f75e-4363-8a6b-edff0cb85579 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:50.284382 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d48a7a03-f75e-4363-8a6b-edff0cb85579 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:50.284837 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d48a7a03-f75e-4363-8a6b-edff0cb85579 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:50.286140 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d48a7a03-f75e-4363-8a6b-edff0cb85579 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:50.286532 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d48a7a03-f75e-4363-8a6b-edff0cb85579 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:50.286945 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d48a7a03-f75e-4363-8a6b-edff0cb85579 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:50.330634 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d48a7a03-f75e-4363-8a6b-edff0cb85579 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120637) unshelve /opt/stack/nova/nova/compute/api.py:4584}} Aug 19 15:30:50.418063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d48a7a03-f75e-4363-8a6b-edff0cb85579 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "POST /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd/action" status: 202 len: 0 microversion: 2.20 time: 0.144476 Aug 19 15:30:50.418809 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 424/854] 10.222.0.75 () {62 vars in 1319 bytes} [Fri Aug 19 15:30:50 2022] POST /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:30:50.427863 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fedb39e1-cbed-4d59-9b8a-74f7addbc091 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:50.436813 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fedb39e1-cbed-4d59-9b8a-74f7addbc091 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:50.444628 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fedb39e1-cbed-4d59-9b8a-74f7addbc091 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:50.445392 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fedb39e1-cbed-4d59-9b8a-74f7addbc091 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:50.445790 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fedb39e1-cbed-4d59-9b8a-74f7addbc091 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:50.446635 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fedb39e1-cbed-4d59-9b8a-74f7addbc091 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:50.447219 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fedb39e1-cbed-4d59-9b8a-74f7addbc091 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:50.447764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fedb39e1-cbed-4d59-9b8a-74f7addbc091 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:50.688704 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fedb39e1-cbed-4d59-9b8a-74f7addbc091 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:50.701430 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fedb39e1-cbed-4d59-9b8a-74f7addbc091 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:50.703349 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fedb39e1-cbed-4d59-9b8a-74f7addbc091 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:50.704818 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fedb39e1-cbed-4d59-9b8a-74f7addbc091 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1749 microversion: 2.20 time: 0.281650 Aug 19 15:30:50.705553 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 431/855] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:50 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1749 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:50.982809 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-b0d7562a-9a46-4ebc-b492-97fe9b433bf0 req-d89bc393-b2f0-48cf-a0f1-56847fa1ea1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b2c2fe-ead2-4d92-b4fb-dc42b41094fd", "name": "network-vif-unplugged", "status": "completed", "tag": "5bf9b7d8-d705-4190-bd01-29213ebc351a"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:30:51.000877 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b0d7562a-9a46-4ebc-b492-97fe9b433bf0 req-d89bc393-b2f0-48cf-a0f1-56847fa1ea1c service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:51.001434 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b0d7562a-9a46-4ebc-b492-97fe9b433bf0 req-d89bc393-b2f0-48cf-a0f1-56847fa1ea1c service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:51.002165 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b0d7562a-9a46-4ebc-b492-97fe9b433bf0 req-d89bc393-b2f0-48cf-a0f1-56847fa1ea1c service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:51.022274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.compute.server_external_events [req-b0d7562a-9a46-4ebc-b492-97fe9b433bf0 req-d89bc393-b2f0-48cf-a0f1-56847fa1ea1c service nova] Unable to find a host for instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd. Dropping event network-vif-unplugged {{(pid=120637) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 19 15:30:51.024158 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-b0d7562a-9a46-4ebc-b492-97fe9b433bf0 req-d89bc393-b2f0-48cf-a0f1-56847fa1ea1c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045236 Aug 19 15:30:51.025036 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 425/856] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 19 15:30:51.734903 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1b10c7c7-b2f9-4bd1-918f-bc169a44356a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:51.735732 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1b10c7c7-b2f9-4bd1-918f-bc169a44356a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:51.743306 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b10c7c7-b2f9-4bd1-918f-bc169a44356a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:51.743849 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b10c7c7-b2f9-4bd1-918f-bc169a44356a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:51.744219 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b10c7c7-b2f9-4bd1-918f-bc169a44356a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:51.745068 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b10c7c7-b2f9-4bd1-918f-bc169a44356a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:51.745496 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b10c7c7-b2f9-4bd1-918f-bc169a44356a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:51.745914 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b10c7c7-b2f9-4bd1-918f-bc169a44356a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:51.907698 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1b10c7c7-b2f9-4bd1-918f-bc169a44356a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:51.920074 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1b10c7c7-b2f9-4bd1-918f-bc169a44356a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:51.921735 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1b10c7c7-b2f9-4bd1-918f-bc169a44356a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:51.923318 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1b10c7c7-b2f9-4bd1-918f-bc169a44356a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1749 microversion: 2.20 time: 0.198134 Aug 19 15:30:51.923907 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 432/857] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:51 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1749 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 15:30:52.947343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e42bc7e0-42b4-43f2-b79e-4430da84a5d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:52.947952 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e42bc7e0-42b4-43f2-b79e-4430da84a5d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:52.954588 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42bc7e0-42b4-43f2-b79e-4430da84a5d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:52.955072 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42bc7e0-42b4-43f2-b79e-4430da84a5d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:52.955501 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42bc7e0-42b4-43f2-b79e-4430da84a5d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:52.956227 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42bc7e0-42b4-43f2-b79e-4430da84a5d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:52.956773 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42bc7e0-42b4-43f2-b79e-4430da84a5d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:52.957635 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42bc7e0-42b4-43f2-b79e-4430da84a5d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:52.961907 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:30:53.098724 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e42bc7e0-42b4-43f2-b79e-4430da84a5d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:53.108333 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e42bc7e0-42b4-43f2-b79e-4430da84a5d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:53.109990 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e42bc7e0-42b4-43f2-b79e-4430da84a5d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:53.111161 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e42bc7e0-42b4-43f2-b79e-4430da84a5d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1807 microversion: 2.20 time: 0.167762 Aug 19 15:30:53.111729 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 426/858] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:52 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:54.135606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7f1230e4-496e-498b-83f0-b16bd54e3727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:54.136349 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7f1230e4-496e-498b-83f0-b16bd54e3727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:54.143587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f1230e4-496e-498b-83f0-b16bd54e3727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:54.144352 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f1230e4-496e-498b-83f0-b16bd54e3727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:54.145862 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f1230e4-496e-498b-83f0-b16bd54e3727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:54.147059 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f1230e4-496e-498b-83f0-b16bd54e3727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:54.147672 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f1230e4-496e-498b-83f0-b16bd54e3727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:54.148333 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f1230e4-496e-498b-83f0-b16bd54e3727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:54.353360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7f1230e4-496e-498b-83f0-b16bd54e3727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:54.369272 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7f1230e4-496e-498b-83f0-b16bd54e3727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:54.372463 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7f1230e4-496e-498b-83f0-b16bd54e3727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:54.374558 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7f1230e4-496e-498b-83f0-b16bd54e3727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1807 microversion: 2.20 time: 0.243119 Aug 19 15:30:54.376333 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 433/859] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:54 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1807 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:55.399963 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d984e312-7b63-44f5-a41f-632fb24922a8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:55.403001 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d984e312-7b63-44f5-a41f-632fb24922a8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:55.411412 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d984e312-7b63-44f5-a41f-632fb24922a8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:55.412156 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d984e312-7b63-44f5-a41f-632fb24922a8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:55.412923 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d984e312-7b63-44f5-a41f-632fb24922a8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:55.413828 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d984e312-7b63-44f5-a41f-632fb24922a8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:55.421321 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d984e312-7b63-44f5-a41f-632fb24922a8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:55.422277 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d984e312-7b63-44f5-a41f-632fb24922a8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:55.638408 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d984e312-7b63-44f5-a41f-632fb24922a8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:55.648539 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d984e312-7b63-44f5-a41f-632fb24922a8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:55.650085 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d984e312-7b63-44f5-a41f-632fb24922a8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:55.651272 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d984e312-7b63-44f5-a41f-632fb24922a8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1807 microversion: 2.20 time: 0.255584 Aug 19 15:30:55.651836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 427/860] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:55 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1807 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 15:30:56.676421 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6286a900-8e70-4fad-9e00-e01e35dfb45e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:56.677408 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6286a900-8e70-4fad-9e00-e01e35dfb45e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:56.694447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6286a900-8e70-4fad-9e00-e01e35dfb45e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:56.694731 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6286a900-8e70-4fad-9e00-e01e35dfb45e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:56.707167 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6286a900-8e70-4fad-9e00-e01e35dfb45e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:56.708427 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6286a900-8e70-4fad-9e00-e01e35dfb45e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:56.709082 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6286a900-8e70-4fad-9e00-e01e35dfb45e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:56.710869 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6286a900-8e70-4fad-9e00-e01e35dfb45e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:56.888011 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6286a900-8e70-4fad-9e00-e01e35dfb45e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:56.899615 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6286a900-8e70-4fad-9e00-e01e35dfb45e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:56.901552 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6286a900-8e70-4fad-9e00-e01e35dfb45e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:56.902975 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6286a900-8e70-4fad-9e00-e01e35dfb45e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1807 microversion: 2.20 time: 0.231782 Aug 19 15:30:56.904089 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 434/861] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:56 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:57.928889 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6954b58d-a52e-46d2-92d8-33e9ac4190d7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:57.930245 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6954b58d-a52e-46d2-92d8-33e9ac4190d7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:57.936824 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6954b58d-a52e-46d2-92d8-33e9ac4190d7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:57.937800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6954b58d-a52e-46d2-92d8-33e9ac4190d7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:57.938493 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6954b58d-a52e-46d2-92d8-33e9ac4190d7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:57.939415 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6954b58d-a52e-46d2-92d8-33e9ac4190d7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:57.940078 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6954b58d-a52e-46d2-92d8-33e9ac4190d7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:57.940804 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6954b58d-a52e-46d2-92d8-33e9ac4190d7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:58.189366 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6954b58d-a52e-46d2-92d8-33e9ac4190d7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:58.206417 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6954b58d-a52e-46d2-92d8-33e9ac4190d7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:58.209633 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6954b58d-a52e-46d2-92d8-33e9ac4190d7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:58.211180 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6954b58d-a52e-46d2-92d8-33e9ac4190d7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1807 microversion: 2.20 time: 0.287618 Aug 19 15:30:58.226907 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 428/862] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:57 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1807 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:30:59.243538 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7e291a94-b65f-46ab-a56d-60a040e86c95 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:30:59.246152 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7e291a94-b65f-46ab-a56d-60a040e86c95 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:30:59.253263 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e291a94-b65f-46ab-a56d-60a040e86c95 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:59.254035 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e291a94-b65f-46ab-a56d-60a040e86c95 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:59.254825 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e291a94-b65f-46ab-a56d-60a040e86c95 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:59.255779 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e291a94-b65f-46ab-a56d-60a040e86c95 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:30:59.256429 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e291a94-b65f-46ab-a56d-60a040e86c95 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:30:59.261186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e291a94-b65f-46ab-a56d-60a040e86c95 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:30:59.493444 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7e291a94-b65f-46ab-a56d-60a040e86c95 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:59.506821 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7e291a94-b65f-46ab-a56d-60a040e86c95 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:59.510142 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7e291a94-b65f-46ab-a56d-60a040e86c95 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:30:59.511492 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7e291a94-b65f-46ab-a56d-60a040e86c95 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1807 microversion: 2.20 time: 0.280183 Aug 19 15:30:59.512208 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 435/863] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:30:59 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1807 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:31:00.541483 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dd50eac5-6f7b-4195-b88c-4aa1258709dc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:00.542159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dd50eac5-6f7b-4195-b88c-4aa1258709dc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:00.551497 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd50eac5-6f7b-4195-b88c-4aa1258709dc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:00.552612 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd50eac5-6f7b-4195-b88c-4aa1258709dc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:00.553387 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd50eac5-6f7b-4195-b88c-4aa1258709dc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:00.554417 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd50eac5-6f7b-4195-b88c-4aa1258709dc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:00.555168 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd50eac5-6f7b-4195-b88c-4aa1258709dc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:00.556198 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd50eac5-6f7b-4195-b88c-4aa1258709dc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:00.778354 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dd50eac5-6f7b-4195-b88c-4aa1258709dc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:00.793344 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dd50eac5-6f7b-4195-b88c-4aa1258709dc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:00.797416 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dd50eac5-6f7b-4195-b88c-4aa1258709dc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:00.806449 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dd50eac5-6f7b-4195-b88c-4aa1258709dc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1807 microversion: 2.20 time: 0.262282 Aug 19 15:31:00.808186 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 429/864] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:31:00 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1807 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:31:01.835378 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fbcb7aa9-a099-4a65-bf8e-fa1102be8076 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:01.836858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fbcb7aa9-a099-4a65-bf8e-fa1102be8076 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:01.850037 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbcb7aa9-a099-4a65-bf8e-fa1102be8076 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:01.851369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbcb7aa9-a099-4a65-bf8e-fa1102be8076 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:01.859617 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbcb7aa9-a099-4a65-bf8e-fa1102be8076 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:01.860996 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbcb7aa9-a099-4a65-bf8e-fa1102be8076 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:01.875467 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbcb7aa9-a099-4a65-bf8e-fa1102be8076 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:01.877111 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbcb7aa9-a099-4a65-bf8e-fa1102be8076 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:02.229957 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fbcb7aa9-a099-4a65-bf8e-fa1102be8076 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:02.240814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fbcb7aa9-a099-4a65-bf8e-fa1102be8076 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:02.242623 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fbcb7aa9-a099-4a65-bf8e-fa1102be8076 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:02.245008 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fbcb7aa9-a099-4a65-bf8e-fa1102be8076 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1807 microversion: 2.20 time: 0.415018 Aug 19 15:31:02.246057 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 436/865] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:31:01 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1807 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:31:03.268741 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-16bb5d61-1836-4a79-b320-e26b4367adbe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:03.271487 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-16bb5d61-1836-4a79-b320-e26b4367adbe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:03.279963 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16bb5d61-1836-4a79-b320-e26b4367adbe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:03.280486 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16bb5d61-1836-4a79-b320-e26b4367adbe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:03.280917 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16bb5d61-1836-4a79-b320-e26b4367adbe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:03.281861 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16bb5d61-1836-4a79-b320-e26b4367adbe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:03.282434 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16bb5d61-1836-4a79-b320-e26b4367adbe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:03.282842 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16bb5d61-1836-4a79-b320-e26b4367adbe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:03.422780 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-16bb5d61-1836-4a79-b320-e26b4367adbe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:03.441195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-16bb5d61-1836-4a79-b320-e26b4367adbe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:03.443069 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-16bb5d61-1836-4a79-b320-e26b4367adbe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:03.444237 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-16bb5d61-1836-4a79-b320-e26b4367adbe tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1807 microversion: 2.20 time: 0.180703 Aug 19 15:31:03.451963 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 430/866] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:31:03 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:31:04.474136 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8dcb034b-269a-44c7-876a-36bf250caa86 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:04.474747 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8dcb034b-269a-44c7-876a-36bf250caa86 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:04.481770 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8dcb034b-269a-44c7-876a-36bf250caa86 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:04.482258 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8dcb034b-269a-44c7-876a-36bf250caa86 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:04.482697 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8dcb034b-269a-44c7-876a-36bf250caa86 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:04.483506 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8dcb034b-269a-44c7-876a-36bf250caa86 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:04.484544 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8dcb034b-269a-44c7-876a-36bf250caa86 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:04.485141 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8dcb034b-269a-44c7-876a-36bf250caa86 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:04.686036 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8dcb034b-269a-44c7-876a-36bf250caa86 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:04.695441 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8dcb034b-269a-44c7-876a-36bf250caa86 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:04.696976 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8dcb034b-269a-44c7-876a-36bf250caa86 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:04.698145 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8dcb034b-269a-44c7-876a-36bf250caa86 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1807 microversion: 2.20 time: 0.228665 Aug 19 15:31:04.709615 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 437/867] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:31:04 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1807 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:31:05.727922 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-80fc4eca-6c83-4f1a-bece-e51c74165b0f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:05.728569 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-80fc4eca-6c83-4f1a-bece-e51c74165b0f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:05.735216 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80fc4eca-6c83-4f1a-bece-e51c74165b0f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:05.735693 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80fc4eca-6c83-4f1a-bece-e51c74165b0f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:05.736149 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80fc4eca-6c83-4f1a-bece-e51c74165b0f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:05.736897 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80fc4eca-6c83-4f1a-bece-e51c74165b0f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:05.737373 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80fc4eca-6c83-4f1a-bece-e51c74165b0f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:05.738099 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80fc4eca-6c83-4f1a-bece-e51c74165b0f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:05.978677 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-80fc4eca-6c83-4f1a-bece-e51c74165b0f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:05.988461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-80fc4eca-6c83-4f1a-bece-e51c74165b0f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:05.991333 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-80fc4eca-6c83-4f1a-bece-e51c74165b0f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:05.992688 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-80fc4eca-6c83-4f1a-bece-e51c74165b0f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1807 microversion: 2.20 time: 0.274333 Aug 19 15:31:05.993333 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 431/868] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:31:05 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1807 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:31:07.015516 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-10f4cdbf-6c89-43a3-84d8-c1f38315e470 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:07.016932 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-10f4cdbf-6c89-43a3-84d8-c1f38315e470 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:07.024890 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10f4cdbf-6c89-43a3-84d8-c1f38315e470 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:07.025583 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10f4cdbf-6c89-43a3-84d8-c1f38315e470 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:07.026211 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10f4cdbf-6c89-43a3-84d8-c1f38315e470 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:07.027230 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10f4cdbf-6c89-43a3-84d8-c1f38315e470 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:07.028052 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10f4cdbf-6c89-43a3-84d8-c1f38315e470 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:07.028667 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10f4cdbf-6c89-43a3-84d8-c1f38315e470 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:07.264681 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-10f4cdbf-6c89-43a3-84d8-c1f38315e470 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:07.278013 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-10f4cdbf-6c89-43a3-84d8-c1f38315e470 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:07.279492 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-10f4cdbf-6c89-43a3-84d8-c1f38315e470 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:07.280668 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-10f4cdbf-6c89-43a3-84d8-c1f38315e470 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1807 microversion: 2.20 time: 0.269101 Aug 19 15:31:07.281227 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 438/869] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:31:07 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1807 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:31:08.303951 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a1d6db54-e316-47db-8fb8-f04564f6d420 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:08.305182 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a1d6db54-e316-47db-8fb8-f04564f6d420 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:08.311942 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1d6db54-e316-47db-8fb8-f04564f6d420 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:08.312721 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1d6db54-e316-47db-8fb8-f04564f6d420 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:08.313334 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1d6db54-e316-47db-8fb8-f04564f6d420 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:08.314199 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1d6db54-e316-47db-8fb8-f04564f6d420 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:08.314814 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1d6db54-e316-47db-8fb8-f04564f6d420 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:08.315394 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1d6db54-e316-47db-8fb8-f04564f6d420 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:08.551535 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a1d6db54-e316-47db-8fb8-f04564f6d420 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:08.562892 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a1d6db54-e316-47db-8fb8-f04564f6d420 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:08.564699 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a1d6db54-e316-47db-8fb8-f04564f6d420 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:08.566089 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a1d6db54-e316-47db-8fb8-f04564f6d420 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1807 microversion: 2.20 time: 0.266900 Aug 19 15:31:08.580417 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 432/870] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:31:08 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1807 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:31:09.589554 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d51041b5-1d6e-4037-82f4-e8c0d7e7a70d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:09.590748 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d51041b5-1d6e-4037-82f4-e8c0d7e7a70d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:09.600430 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d51041b5-1d6e-4037-82f4-e8c0d7e7a70d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:09.601195 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d51041b5-1d6e-4037-82f4-e8c0d7e7a70d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:09.601937 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d51041b5-1d6e-4037-82f4-e8c0d7e7a70d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:09.603212 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d51041b5-1d6e-4037-82f4-e8c0d7e7a70d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:09.603852 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d51041b5-1d6e-4037-82f4-e8c0d7e7a70d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:09.604590 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d51041b5-1d6e-4037-82f4-e8c0d7e7a70d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:09.853400 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d51041b5-1d6e-4037-82f4-e8c0d7e7a70d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:09.864444 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d51041b5-1d6e-4037-82f4-e8c0d7e7a70d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:09.866396 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d51041b5-1d6e-4037-82f4-e8c0d7e7a70d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:09.867947 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d51041b5-1d6e-4037-82f4-e8c0d7e7a70d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1807 microversion: 2.20 time: 0.282104 Aug 19 15:31:09.868813 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 439/871] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:31:09 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1807 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:31:10.511102 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-82e9f0e7-f427-4918-a955-bdf6afc0dc55 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Action: 'create', calling method: .version_select at 0x7fb53361ec10>, body: {"keypair": {"name": "tempest-TestShelveInstance-936999056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQGql0JabLNKkeAgYE7jROW1UQXDJXtpaWwcOgDS+iVHknLZvHorHzejQnKBaM6Eq8Za2HbcSjqscaW1iYg6UOXBxInZwnBhgc2MwsS4cdUkL0iDmkaLWoQt2JJWYxWcw=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:31:10.534273 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-82e9f0e7-f427-4918-a955-bdf6afc0dc55 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Getting quotas for project 7111b041a72b4481b3c8a286589e0a4e. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:31:10.539050 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-82e9f0e7-f427-4918-a955-bdf6afc0dc55 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Getting quotas for user 55a7b30c3c094a8088c370a0d79ac98a and project 7111b041a72b4481b3c8a286589e0a4e. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:31:10.565999 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-82e9f0e7-f427-4918-a955-bdf6afc0dc55 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.362691 Aug 19 15:31:10.567059 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 433/872] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Aug 19 15:31:10 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:31:10.893796 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fee588ce-d65e-4235-8db3-d17d20cb0478 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:10.894994 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fee588ce-d65e-4235-8db3-d17d20cb0478 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:10.902161 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fee588ce-d65e-4235-8db3-d17d20cb0478 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:10.902691 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fee588ce-d65e-4235-8db3-d17d20cb0478 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:10.903175 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fee588ce-d65e-4235-8db3-d17d20cb0478 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:10.903818 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fee588ce-d65e-4235-8db3-d17d20cb0478 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:10.904978 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fee588ce-d65e-4235-8db3-d17d20cb0478 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:10.905561 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fee588ce-d65e-4235-8db3-d17d20cb0478 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:11.126900 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fee588ce-d65e-4235-8db3-d17d20cb0478 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:11.141256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fee588ce-d65e-4235-8db3-d17d20cb0478 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:11.146809 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fee588ce-d65e-4235-8db3-d17d20cb0478 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:11.152761 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fee588ce-d65e-4235-8db3-d17d20cb0478 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1807 microversion: 2.20 time: 0.263491 Aug 19 15:31:11.153903 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 440/873] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:31:10 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1807 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:31:12.177676 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee5cbf16-8d66-4c81-8efa-97480f06e7ac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:12.178972 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee5cbf16-8d66-4c81-8efa-97480f06e7ac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:12.188524 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5cbf16-8d66-4c81-8efa-97480f06e7ac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:12.189333 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5cbf16-8d66-4c81-8efa-97480f06e7ac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:12.189996 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5cbf16-8d66-4c81-8efa-97480f06e7ac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:12.190868 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5cbf16-8d66-4c81-8efa-97480f06e7ac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:12.191386 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5cbf16-8d66-4c81-8efa-97480f06e7ac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:12.191817 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5cbf16-8d66-4c81-8efa-97480f06e7ac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:12.358377 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ee5cbf16-8d66-4c81-8efa-97480f06e7ac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:12.369271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ee5cbf16-8d66-4c81-8efa-97480f06e7ac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:12.371332 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ee5cbf16-8d66-4c81-8efa-97480f06e7ac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:12.372534 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee5cbf16-8d66-4c81-8efa-97480f06e7ac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1807 microversion: 2.20 time: 0.199884 Aug 19 15:31:12.373097 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 434/874] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:31:12 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:31:13.099970 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-ab78f1b3-b91d-4736-b4cc-a8d6f81aec63 req-da6a8517-2005-4fa2-8b41-7c3e11374b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b2c2fe-ead2-4d92-b4fb-dc42b41094fd", "name": "network-vif-plugged", "status": "completed", "tag": "5bf9b7d8-d705-4190-bd01-29213ebc351a"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:31:13.115311 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-ab78f1b3-b91d-4736-b4cc-a8d6f81aec63 req-da6a8517-2005-4fa2-8b41-7c3e11374b11 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:13.116677 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-ab78f1b3-b91d-4736-b4cc-a8d6f81aec63 req-da6a8517-2005-4fa2-8b41-7c3e11374b11 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:13.117337 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-ab78f1b3-b91d-4736-b4cc-a8d6f81aec63 req-da6a8517-2005-4fa2-8b41-7c3e11374b11 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:13.138784 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-ab78f1b3-b91d-4736-b4cc-a8d6f81aec63 req-da6a8517-2005-4fa2-8b41-7c3e11374b11 service nova] Creating event network-vif-plugged:5bf9b7d8-d705-4190-bd01-29213ebc351a for instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd on hv-cinder-83538 Aug 19 15:31:13.148991 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-ab78f1b3-b91d-4736-b4cc-a8d6f81aec63 req-da6a8517-2005-4fa2-8b41-7c3e11374b11 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056665 Aug 19 15:31:13.149870 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 441/875] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:31:13.398227 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2f21692-10cf-4d12-ae37-a63a01d3d362 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:13.399135 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e2f21692-10cf-4d12-ae37-a63a01d3d362 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:13.412982 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2f21692-10cf-4d12-ae37-a63a01d3d362 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:13.413562 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2f21692-10cf-4d12-ae37-a63a01d3d362 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:13.414449 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2f21692-10cf-4d12-ae37-a63a01d3d362 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:13.415157 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2f21692-10cf-4d12-ae37-a63a01d3d362 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:13.415708 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2f21692-10cf-4d12-ae37-a63a01d3d362 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:13.416021 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2f21692-10cf-4d12-ae37-a63a01d3d362 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:13.929372 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e2f21692-10cf-4d12-ae37-a63a01d3d362 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:13.943142 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e2f21692-10cf-4d12-ae37-a63a01d3d362 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:13.944772 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e2f21692-10cf-4d12-ae37-a63a01d3d362 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:13.945949 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e2f21692-10cf-4d12-ae37-a63a01d3d362 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1807 microversion: 2.20 time: 0.552898 Aug 19 15:31:13.946510 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 435/876] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:31:13 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1807 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:31:14.971086 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-25cfcded-42ce-4d76-a86f-b8f1ed9b73c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:14.971789 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-25cfcded-42ce-4d76-a86f-b8f1ed9b73c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:14.978761 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25cfcded-42ce-4d76-a86f-b8f1ed9b73c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:14.979243 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25cfcded-42ce-4d76-a86f-b8f1ed9b73c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:14.979672 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25cfcded-42ce-4d76-a86f-b8f1ed9b73c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:14.980360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25cfcded-42ce-4d76-a86f-b8f1ed9b73c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:14.980840 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25cfcded-42ce-4d76-a86f-b8f1ed9b73c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:14.981287 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25cfcded-42ce-4d76-a86f-b8f1ed9b73c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:15.118643 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-25cfcded-42ce-4d76-a86f-b8f1ed9b73c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:15.127523 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-25cfcded-42ce-4d76-a86f-b8f1ed9b73c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:15.129689 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-25cfcded-42ce-4d76-a86f-b8f1ed9b73c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:15.131274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-25cfcded-42ce-4d76-a86f-b8f1ed9b73c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1807 microversion: 2.20 time: 0.166003 Aug 19 15:31:15.131911 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 442/877] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:31:14 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:31:16.155015 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3adfca91-ab8e-4d7b-93d8-23af7f99ef03 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:16.155640 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3adfca91-ab8e-4d7b-93d8-23af7f99ef03 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:16.162475 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3adfca91-ab8e-4d7b-93d8-23af7f99ef03 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:16.162950 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3adfca91-ab8e-4d7b-93d8-23af7f99ef03 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:16.163376 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3adfca91-ab8e-4d7b-93d8-23af7f99ef03 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:16.164057 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3adfca91-ab8e-4d7b-93d8-23af7f99ef03 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:16.164533 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3adfca91-ab8e-4d7b-93d8-23af7f99ef03 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:16.164952 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3adfca91-ab8e-4d7b-93d8-23af7f99ef03 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:16.312005 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3adfca91-ab8e-4d7b-93d8-23af7f99ef03 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:16.321666 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3adfca91-ab8e-4d7b-93d8-23af7f99ef03 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:16.323155 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3adfca91-ab8e-4d7b-93d8-23af7f99ef03 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:16.324305 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3adfca91-ab8e-4d7b-93d8-23af7f99ef03 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1794 microversion: 2.20 time: 0.173297 Aug 19 15:31:16.324890 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 436/878] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:31:16 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1794 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:31:26.078808 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1459218420", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1301407205", "security_groups": [{"name": "tempest-secgroup-smoke-614027275"}], "block_device_mapping_v2": [{"uuid": "abdfad24-bd98-4524-8afc-a04bddc5fae6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6ddc4f9f-3c90-4d2a-9cf9-1e79206f98a8"}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:31:26.089317 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=29 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:31:26.089985 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=75,nova_cell1:INSERT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:31:26.193003 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] validate_networks() for [('6ddc4f9f-3c90-4d2a-9cf9-1e79206f98a8', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:31:26.583329 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:31:26.583748 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:31:26.584217 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:31:26.585198 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:31:26.585671 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:31:26.595701 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:26.596184 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:26.596656 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:26.597383 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:26.597833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:26.598257 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:26.615422 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Getting quotas for project 0add00db6668475093f558e9700333d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:31:26.619415 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Getting quotas for user af3e7eea0b2840b79404b370382ab44a and project 0add00db6668475093f558e9700333d1. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:31:26.676981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:31:26.679413 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='abdfad24-bd98-4524-8afc-a04bddc5fae6',volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:31:26.806134 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR oslo.messaging._drivers.impl_rabbit [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [60aef8d6-6ecb-47bf-b02c-44c6c651737c] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 19 15:31:27.813187 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [60aef8d6-6ecb-47bf-b02c-44c6c651737c] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 45992. Aug 19 15:31:27.816907 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-47cded45-115d-486d-a116-33ef9bfa2e3d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.742019 Aug 19 15:31:27.817563 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 443/879] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:31:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 15:31:27.828948 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-16999b73-84ee-4dd4-8e10-59238bf7d1f2 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:27.829555 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-16999b73-84ee-4dd4-8e10-59238bf7d1f2 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:27.831854 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:31:27.832755 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:31:27.833867 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=59 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:31:27.888491 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-16999b73-84ee-4dd4-8e10-59238bf7d1f2 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:27.895231 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-16999b73-84ee-4dd4-8e10-59238bf7d1f2 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1095 microversion: 2.1 time: 0.070153 Aug 19 15:31:27.895787 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 437/880] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:27 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:28.917841 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-da7227c1-ed54-4521-8b40-90278d7fdf6c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:28.918572 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-da7227c1-ed54-4521-8b40-90278d7fdf6c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:28.973176 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-da7227c1-ed54-4521-8b40-90278d7fdf6c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:28.980652 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-da7227c1-ed54-4521-8b40-90278d7fdf6c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1095 microversion: 2.1 time: 0.068260 Aug 19 15:31:28.981211 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 444/881] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:28 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:29.430052 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1ee5d631-1d78-4a2c-b551-1681bfa58ff1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2078334150", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-936999056", "security_groups": [{"name": "tempest-secgroup-smoke-1228397413"}], "networks": [{"uuid": "79008e7b-f33e-4610-a522-4d5d851ee288"}], "block_device_mapping_v2": [{"uuid": "3d5c0b2b-ac2c-41d1-9907-144a15df9319", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:31:29.545819 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-1ee5d631-1d78-4a2c-b551-1681bfa58ff1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] validate_networks() for [('79008e7b-f33e-4610-a522-4d5d851ee288', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:31:29.912131 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-1ee5d631-1d78-4a2c-b551-1681bfa58ff1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:31:29.912596 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-1ee5d631-1d78-4a2c-b551-1681bfa58ff1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:31:29.916177 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-1ee5d631-1d78-4a2c-b551-1681bfa58ff1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:31:29.916177 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-1ee5d631-1d78-4a2c-b551-1681bfa58ff1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:31:29.916177 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-1ee5d631-1d78-4a2c-b551-1681bfa58ff1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:31:29.923815 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ee5d631-1d78-4a2c-b551-1681bfa58ff1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:29.924301 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ee5d631-1d78-4a2c-b551-1681bfa58ff1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:29.924774 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ee5d631-1d78-4a2c-b551-1681bfa58ff1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:29.925503 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ee5d631-1d78-4a2c-b551-1681bfa58ff1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:29.925956 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ee5d631-1d78-4a2c-b551-1681bfa58ff1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:29.926379 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ee5d631-1d78-4a2c-b551-1681bfa58ff1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:29.946402 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-1ee5d631-1d78-4a2c-b551-1681bfa58ff1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Getting quotas for project 7111b041a72b4481b3c8a286589e0a4e. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:31:29.950375 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-1ee5d631-1d78-4a2c-b551-1681bfa58ff1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Getting quotas for user 55a7b30c3c094a8088c370a0d79ac98a and project 7111b041a72b4481b3c8a286589e0a4e. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:31:30.000906 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-db4cdd99-0883-47e8-8d8e-f5e55d081128 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:30.001516 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-db4cdd99-0883-47e8-8d8e-f5e55d081128 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:30.011557 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1ee5d631-1d78-4a2c-b551-1681bfa58ff1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:31:30.013718 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1ee5d631-1d78-4a2c-b551-1681bfa58ff1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d5c0b2b-ac2c-41d1-9907-144a15df9319',volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:31:30.063727 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-db4cdd99-0883-47e8-8d8e-f5e55d081128 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:30.072321 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-db4cdd99-0883-47e8-8d8e-f5e55d081128 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1095 microversion: 2.1 time: 0.075095 Aug 19 15:31:30.073012 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 445/882] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:29 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:30.158776 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1ee5d631-1d78-4a2c-b551-1681bfa58ff1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.733341 Aug 19 15:31:30.159521 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 438/883] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:31:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 15:31:30.170375 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-112763c6-c4f1-48d9-8a08-31f6e729ab34 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:30.170897 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-112763c6-c4f1-48d9-8a08-31f6e729ab34 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:30.223592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-112763c6-c4f1-48d9-8a08-31f6e729ab34 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:30.230804 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-112763c6-c4f1-48d9-8a08-31f6e729ab34 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1088 microversion: 2.1 time: 0.064445 Aug 19 15:31:30.231370 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 446/884] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:30 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1088 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:31.094609 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ccb6d076-843d-4f09-8aae-1ddfa5fe8bb7 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:31.095345 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ccb6d076-843d-4f09-8aae-1ddfa5fe8bb7 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:31.158447 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ccb6d076-843d-4f09-8aae-1ddfa5fe8bb7 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:31.169288 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ccb6d076-843d-4f09-8aae-1ddfa5fe8bb7 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1095 microversion: 2.1 time: 0.078969 Aug 19 15:31:31.170695 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 439/885] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:31 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:31.252830 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-30c4e38d-bc15-43d3-ab4f-ffbdc6700f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:31.254582 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-30c4e38d-bc15-43d3-ab4f-ffbdc6700f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:31.271492 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30c4e38d-bc15-43d3-ab4f-ffbdc6700f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:31.272020 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30c4e38d-bc15-43d3-ab4f-ffbdc6700f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:31.272550 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30c4e38d-bc15-43d3-ab4f-ffbdc6700f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:31.274285 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30c4e38d-bc15-43d3-ab4f-ffbdc6700f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:31.275071 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30c4e38d-bc15-43d3-ab4f-ffbdc6700f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:31.275829 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30c4e38d-bc15-43d3-ab4f-ffbdc6700f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:31.346076 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-30c4e38d-bc15-43d3-ab4f-ffbdc6700f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:31.354187 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-30c4e38d-bc15-43d3-ab4f-ffbdc6700f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1204 microversion: 2.1 time: 0.106258 Aug 19 15:31:31.354838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 447/886] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:31 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1204 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:32.190546 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-84a64595-a0a8-4f11-b9b7-ea7a8e1bf90d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:32.191162 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-84a64595-a0a8-4f11-b9b7-ea7a8e1bf90d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:32.198958 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84a64595-a0a8-4f11-b9b7-ea7a8e1bf90d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:32.199444 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84a64595-a0a8-4f11-b9b7-ea7a8e1bf90d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:32.199879 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84a64595-a0a8-4f11-b9b7-ea7a8e1bf90d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:32.200601 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84a64595-a0a8-4f11-b9b7-ea7a8e1bf90d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:32.201051 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84a64595-a0a8-4f11-b9b7-ea7a8e1bf90d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:32.201478 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84a64595-a0a8-4f11-b9b7-ea7a8e1bf90d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:32.263949 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-84a64595-a0a8-4f11-b9b7-ea7a8e1bf90d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:32.271660 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-84a64595-a0a8-4f11-b9b7-ea7a8e1bf90d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1145 microversion: 2.1 time: 0.085062 Aug 19 15:31:32.272266 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 440/887] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:32 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:32.375251 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4e2dd545-12ba-42d3-a4e5-ad4fc6e36651 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:32.376019 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4e2dd545-12ba-42d3-a4e5-ad4fc6e36651 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:32.384215 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2dd545-12ba-42d3-a4e5-ad4fc6e36651 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:32.384970 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2dd545-12ba-42d3-a4e5-ad4fc6e36651 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:32.385586 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2dd545-12ba-42d3-a4e5-ad4fc6e36651 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:32.386340 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2dd545-12ba-42d3-a4e5-ad4fc6e36651 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:32.386792 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2dd545-12ba-42d3-a4e5-ad4fc6e36651 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:32.387202 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2dd545-12ba-42d3-a4e5-ad4fc6e36651 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:32.527530 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-787f4480-2531-4185-9161-3868469d7d21 req-9326c70c-94ff-4fea-bebb-cb061e68ed06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "446054b4-8b4f-45ec-9e9b-4a552af02065", "tag": "202d895f-8706-4b55-b8a7-80568bae22d1"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:31:32.545580 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-787f4480-2531-4185-9161-3868469d7d21 req-9326c70c-94ff-4fea-bebb-cb061e68ed06 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:32.546057 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-787f4480-2531-4185-9161-3868469d7d21 req-9326c70c-94ff-4fea-bebb-cb061e68ed06 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:32.546473 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-787f4480-2531-4185-9161-3868469d7d21 req-9326c70c-94ff-4fea-bebb-cb061e68ed06 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:32.546637 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4e2dd545-12ba-42d3-a4e5-ad4fc6e36651 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:32.561200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-787f4480-2531-4185-9161-3868469d7d21 req-9326c70c-94ff-4fea-bebb-cb061e68ed06 service nova] Creating event network-changed:202d895f-8706-4b55-b8a7-80568bae22d1 for instance 446054b4-8b4f-45ec-9e9b-4a552af02065 on hv-cinder-83538 Aug 19 15:31:32.561430 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4e2dd545-12ba-42d3-a4e5-ad4fc6e36651 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1260 microversion: 2.1 time: 0.189777 Aug 19 15:31:32.563049 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 448/888] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:32 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:32.567592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-787f4480-2531-4185-9161-3868469d7d21 req-9326c70c-94ff-4fea-bebb-cb061e68ed06 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045501 Aug 19 15:31:32.568565 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 441/889] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:31:32.839790 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 15:31:32.840352 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Fri Aug 19 15:31:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 15:31:33.292019 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e7536352-d921-4746-8883-05facda9efdf tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:33.292756 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e7536352-d921-4746-8883-05facda9efdf tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:33.298783 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7536352-d921-4746-8883-05facda9efdf tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:33.299276 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7536352-d921-4746-8883-05facda9efdf tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:33.299687 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7536352-d921-4746-8883-05facda9efdf tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:33.300372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7536352-d921-4746-8883-05facda9efdf tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:33.300844 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7536352-d921-4746-8883-05facda9efdf tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:33.301270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7536352-d921-4746-8883-05facda9efdf tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:33.370608 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e7536352-d921-4746-8883-05facda9efdf tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:33.378958 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e7536352-d921-4746-8883-05facda9efdf tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1211 microversion: 2.1 time: 0.090959 Aug 19 15:31:33.379849 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 449/890] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:33 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:33.586875 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5cf0a80a-1d4e-4923-ac22-370eb91898f9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:33.587578 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5cf0a80a-1d4e-4923-ac22-370eb91898f9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:33.594222 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cf0a80a-1d4e-4923-ac22-370eb91898f9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:33.594702 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cf0a80a-1d4e-4923-ac22-370eb91898f9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:33.595133 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cf0a80a-1d4e-4923-ac22-370eb91898f9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:33.595821 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cf0a80a-1d4e-4923-ac22-370eb91898f9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:33.596272 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cf0a80a-1d4e-4923-ac22-370eb91898f9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:33.596719 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cf0a80a-1d4e-4923-ac22-370eb91898f9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:33.738436 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5cf0a80a-1d4e-4923-ac22-370eb91898f9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:33.761952 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5cf0a80a-1d4e-4923-ac22-370eb91898f9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1260 microversion: 2.1 time: 0.176653 Aug 19 15:31:33.763065 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 442/891] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:33 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:34.400242 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-07b0b3cd-8b31-415f-b6b6-fed317f255fa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:34.401358 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-07b0b3cd-8b31-415f-b6b6-fed317f255fa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:34.407682 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07b0b3cd-8b31-415f-b6b6-fed317f255fa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:34.408164 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07b0b3cd-8b31-415f-b6b6-fed317f255fa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:34.408626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07b0b3cd-8b31-415f-b6b6-fed317f255fa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:34.409320 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07b0b3cd-8b31-415f-b6b6-fed317f255fa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:34.409772 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07b0b3cd-8b31-415f-b6b6-fed317f255fa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:34.410190 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07b0b3cd-8b31-415f-b6b6-fed317f255fa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:34.544319 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-07b0b3cd-8b31-415f-b6b6-fed317f255fa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:34.552131 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-07b0b3cd-8b31-415f-b6b6-fed317f255fa tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1266 microversion: 2.1 time: 0.156358 Aug 19 15:31:34.552993 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 450/892] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:34 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:34.784840 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3c037b1f-e738-4655-b95d-7d6acaad7418 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:34.785546 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3c037b1f-e738-4655-b95d-7d6acaad7418 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:34.791873 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c037b1f-e738-4655-b95d-7d6acaad7418 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:34.792282 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c037b1f-e738-4655-b95d-7d6acaad7418 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:34.792735 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c037b1f-e738-4655-b95d-7d6acaad7418 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:34.793431 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c037b1f-e738-4655-b95d-7d6acaad7418 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:34.793877 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c037b1f-e738-4655-b95d-7d6acaad7418 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:34.794295 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c037b1f-e738-4655-b95d-7d6acaad7418 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:34.936562 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3c037b1f-e738-4655-b95d-7d6acaad7418 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:34.944514 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3c037b1f-e738-4655-b95d-7d6acaad7418 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1260 microversion: 2.1 time: 0.165266 Aug 19 15:31:34.945460 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 443/893] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:34 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:35.043670 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-b57feab3-db57-4344-b488-fe00996771a4 req-89e35917-ccf5-45b1-91d8-e813987a22b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "265f2d7d-c0ad-4cc7-bf83-27ea63353ecd", "tag": "a4de4f1a-9970-4238-889e-a094171b341d"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:31:35.055164 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-b57feab3-db57-4344-b488-fe00996771a4 req-89e35917-ccf5-45b1-91d8-e813987a22b1 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:35.056244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-b57feab3-db57-4344-b488-fe00996771a4 req-89e35917-ccf5-45b1-91d8-e813987a22b1 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:35.056726 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-b57feab3-db57-4344-b488-fe00996771a4 req-89e35917-ccf5-45b1-91d8-e813987a22b1 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:35.068494 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-b57feab3-db57-4344-b488-fe00996771a4 req-89e35917-ccf5-45b1-91d8-e813987a22b1 service nova] Creating event network-changed:a4de4f1a-9970-4238-889e-a094171b341d for instance 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd on hv-cinder-83538 Aug 19 15:31:35.074188 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-b57feab3-db57-4344-b488-fe00996771a4 req-89e35917-ccf5-45b1-91d8-e813987a22b1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034269 Aug 19 15:31:35.075026 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 451/894] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:31:35.573530 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1a9c7efc-3dcd-45b0-af41-bb762dae2ca7 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:35.574131 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1a9c7efc-3dcd-45b0-af41-bb762dae2ca7 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:35.580251 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a9c7efc-3dcd-45b0-af41-bb762dae2ca7 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:35.580749 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a9c7efc-3dcd-45b0-af41-bb762dae2ca7 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:35.581176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a9c7efc-3dcd-45b0-af41-bb762dae2ca7 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:35.581846 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a9c7efc-3dcd-45b0-af41-bb762dae2ca7 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:35.582291 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a9c7efc-3dcd-45b0-af41-bb762dae2ca7 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:35.582707 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a9c7efc-3dcd-45b0-af41-bb762dae2ca7 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:35.713951 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1a9c7efc-3dcd-45b0-af41-bb762dae2ca7 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:35.722983 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1a9c7efc-3dcd-45b0-af41-bb762dae2ca7 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1266 microversion: 2.1 time: 0.153933 Aug 19 15:31:35.723598 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 444/895] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:35 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:35.966244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f4b31913-775e-404d-8b93-503f14b618e4 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:35.967072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f4b31913-775e-404d-8b93-503f14b618e4 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:35.973598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4b31913-775e-404d-8b93-503f14b618e4 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:35.974074 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4b31913-775e-404d-8b93-503f14b618e4 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:35.974501 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4b31913-775e-404d-8b93-503f14b618e4 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:35.975183 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4b31913-775e-404d-8b93-503f14b618e4 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:35.975669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4b31913-775e-404d-8b93-503f14b618e4 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:35.976645 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4b31913-775e-404d-8b93-503f14b618e4 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:36.114906 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f4b31913-775e-404d-8b93-503f14b618e4 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:36.122828 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f4b31913-775e-404d-8b93-503f14b618e4 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1260 microversion: 2.1 time: 0.160734 Aug 19 15:31:36.123402 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 452/896] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:35 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:36.743282 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-40ec4740-99ef-4b41-bbcd-af6be1691ca3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:36.743921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-40ec4740-99ef-4b41-bbcd-af6be1691ca3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:36.750410 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40ec4740-99ef-4b41-bbcd-af6be1691ca3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:36.750886 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40ec4740-99ef-4b41-bbcd-af6be1691ca3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:36.751320 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40ec4740-99ef-4b41-bbcd-af6be1691ca3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:36.751995 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40ec4740-99ef-4b41-bbcd-af6be1691ca3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:36.752502 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40ec4740-99ef-4b41-bbcd-af6be1691ca3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:36.752922 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40ec4740-99ef-4b41-bbcd-af6be1691ca3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:36.886400 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-40ec4740-99ef-4b41-bbcd-af6be1691ca3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:36.894036 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-40ec4740-99ef-4b41-bbcd-af6be1691ca3 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1266 microversion: 2.1 time: 0.154864 Aug 19 15:31:36.894601 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 445/897] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:36 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:37.143043 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3c1c0844-c156-4157-8e8b-d83c9e99bd99 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:37.143651 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3c1c0844-c156-4157-8e8b-d83c9e99bd99 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:37.145581 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:31:37.151558 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c1c0844-c156-4157-8e8b-d83c9e99bd99 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:37.152033 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c1c0844-c156-4157-8e8b-d83c9e99bd99 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:37.152482 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c1c0844-c156-4157-8e8b-d83c9e99bd99 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:37.153162 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c1c0844-c156-4157-8e8b-d83c9e99bd99 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:37.153606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c1c0844-c156-4157-8e8b-d83c9e99bd99 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:37.154021 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c1c0844-c156-4157-8e8b-d83c9e99bd99 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:37.283962 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3c1c0844-c156-4157-8e8b-d83c9e99bd99 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:37.292424 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3c1c0844-c156-4157-8e8b-d83c9e99bd99 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1260 microversion: 2.1 time: 0.153225 Aug 19 15:31:37.292996 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 453/898] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:37 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:37.915672 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-77be12c6-3414-4c43-808c-81c0b2670e0f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:37.916276 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-77be12c6-3414-4c43-808c-81c0b2670e0f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:37.922729 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77be12c6-3414-4c43-808c-81c0b2670e0f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:37.923216 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77be12c6-3414-4c43-808c-81c0b2670e0f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:37.923651 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77be12c6-3414-4c43-808c-81c0b2670e0f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:37.924340 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77be12c6-3414-4c43-808c-81c0b2670e0f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:37.924818 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77be12c6-3414-4c43-808c-81c0b2670e0f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:37.925240 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77be12c6-3414-4c43-808c-81c0b2670e0f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:38.063876 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-77be12c6-3414-4c43-808c-81c0b2670e0f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:38.071978 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-77be12c6-3414-4c43-808c-81c0b2670e0f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1266 microversion: 2.1 time: 0.160307 Aug 19 15:31:38.072572 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 446/899] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:37 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:38.313157 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-43ac6f38-d916-4d3f-81bf-bf40af9a0363 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:38.313741 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-43ac6f38-d916-4d3f-81bf-bf40af9a0363 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:38.320655 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43ac6f38-d916-4d3f-81bf-bf40af9a0363 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:38.321136 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43ac6f38-d916-4d3f-81bf-bf40af9a0363 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:38.321560 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43ac6f38-d916-4d3f-81bf-bf40af9a0363 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:38.322232 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43ac6f38-d916-4d3f-81bf-bf40af9a0363 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:38.322681 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43ac6f38-d916-4d3f-81bf-bf40af9a0363 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:38.323094 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43ac6f38-d916-4d3f-81bf-bf40af9a0363 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:38.452333 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-43ac6f38-d916-4d3f-81bf-bf40af9a0363 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:38.460130 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-43ac6f38-d916-4d3f-81bf-bf40af9a0363 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1260 microversion: 2.1 time: 0.150876 Aug 19 15:31:38.461854 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 454/900] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:38 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:39.092654 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ecec2179-a94d-45bc-9fde-be3f5a128d8c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:39.093253 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ecec2179-a94d-45bc-9fde-be3f5a128d8c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:39.099636 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecec2179-a94d-45bc-9fde-be3f5a128d8c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:39.100115 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecec2179-a94d-45bc-9fde-be3f5a128d8c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:39.100580 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecec2179-a94d-45bc-9fde-be3f5a128d8c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:39.101800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecec2179-a94d-45bc-9fde-be3f5a128d8c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:39.102274 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecec2179-a94d-45bc-9fde-be3f5a128d8c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:39.102622 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecec2179-a94d-45bc-9fde-be3f5a128d8c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:39.235096 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ecec2179-a94d-45bc-9fde-be3f5a128d8c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:39.243590 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ecec2179-a94d-45bc-9fde-be3f5a128d8c tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1266 microversion: 2.1 time: 0.154809 Aug 19 15:31:39.244153 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 447/901] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:39 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:39.482526 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-26c7f4d1-89e5-40f4-9ef2-796313a47b6c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:39.483126 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-26c7f4d1-89e5-40f4-9ef2-796313a47b6c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:39.489566 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26c7f4d1-89e5-40f4-9ef2-796313a47b6c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:39.490038 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26c7f4d1-89e5-40f4-9ef2-796313a47b6c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:39.490465 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26c7f4d1-89e5-40f4-9ef2-796313a47b6c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:39.491142 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26c7f4d1-89e5-40f4-9ef2-796313a47b6c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:39.491584 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26c7f4d1-89e5-40f4-9ef2-796313a47b6c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:39.492719 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26c7f4d1-89e5-40f4-9ef2-796313a47b6c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:39.627432 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-26c7f4d1-89e5-40f4-9ef2-796313a47b6c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:39.635426 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-26c7f4d1-89e5-40f4-9ef2-796313a47b6c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1260 microversion: 2.1 time: 0.156806 Aug 19 15:31:39.635923 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 455/902] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:39 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:40.264641 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-325b4edf-ce9b-4c9d-a0a6-63f6d23c5769 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:40.265273 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-325b4edf-ce9b-4c9d-a0a6-63f6d23c5769 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:40.267189 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:31:40.273069 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-325b4edf-ce9b-4c9d-a0a6-63f6d23c5769 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:40.273617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-325b4edf-ce9b-4c9d-a0a6-63f6d23c5769 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:40.273994 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-325b4edf-ce9b-4c9d-a0a6-63f6d23c5769 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:40.274673 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-325b4edf-ce9b-4c9d-a0a6-63f6d23c5769 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:40.275118 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-325b4edf-ce9b-4c9d-a0a6-63f6d23c5769 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:40.275535 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-325b4edf-ce9b-4c9d-a0a6-63f6d23c5769 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:40.406577 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-325b4edf-ce9b-4c9d-a0a6-63f6d23c5769 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:40.414166 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-325b4edf-ce9b-4c9d-a0a6-63f6d23c5769 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1266 microversion: 2.1 time: 0.153417 Aug 19 15:31:40.414722 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 448/903] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:40 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:40.657670 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-09e34305-fff5-4a3a-be7a-f9a367907fa2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:40.658312 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-09e34305-fff5-4a3a-be7a-f9a367907fa2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:40.660232 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=12 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:31:40.667256 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09e34305-fff5-4a3a-be7a-f9a367907fa2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:40.667751 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09e34305-fff5-4a3a-be7a-f9a367907fa2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:40.668168 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09e34305-fff5-4a3a-be7a-f9a367907fa2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:40.669075 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09e34305-fff5-4a3a-be7a-f9a367907fa2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:40.669532 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09e34305-fff5-4a3a-be7a-f9a367907fa2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:40.669953 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09e34305-fff5-4a3a-be7a-f9a367907fa2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:40.803580 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-09e34305-fff5-4a3a-be7a-f9a367907fa2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:40.811920 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-09e34305-fff5-4a3a-be7a-f9a367907fa2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1260 microversion: 2.1 time: 0.158066 Aug 19 15:31:40.812507 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 456/904] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:40 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:41.434962 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5d9498cd-3bdd-4d07-904b-79304e29568f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:41.435508 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d9498cd-3bdd-4d07-904b-79304e29568f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:41.437391 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=10 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:31:41.443054 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d9498cd-3bdd-4d07-904b-79304e29568f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:41.443531 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d9498cd-3bdd-4d07-904b-79304e29568f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:41.443959 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d9498cd-3bdd-4d07-904b-79304e29568f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:41.444660 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d9498cd-3bdd-4d07-904b-79304e29568f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:41.445792 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d9498cd-3bdd-4d07-904b-79304e29568f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:41.446453 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d9498cd-3bdd-4d07-904b-79304e29568f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:41.579087 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5d9498cd-3bdd-4d07-904b-79304e29568f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:41.587494 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5d9498cd-3bdd-4d07-904b-79304e29568f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1266 microversion: 2.1 time: 0.156391 Aug 19 15:31:41.588076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 449/905] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:41 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:41.831932 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-057569ba-5f89-43ff-9800-c3842afd628b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:41.832587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-057569ba-5f89-43ff-9800-c3842afd628b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:41.839630 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-057569ba-5f89-43ff-9800-c3842afd628b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:41.840104 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-057569ba-5f89-43ff-9800-c3842afd628b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:41.840567 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-057569ba-5f89-43ff-9800-c3842afd628b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:41.841258 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-057569ba-5f89-43ff-9800-c3842afd628b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:41.841706 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-057569ba-5f89-43ff-9800-c3842afd628b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:41.842124 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-057569ba-5f89-43ff-9800-c3842afd628b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:41.975377 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-057569ba-5f89-43ff-9800-c3842afd628b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:41.983758 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-057569ba-5f89-43ff-9800-c3842afd628b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1260 microversion: 2.1 time: 0.155540 Aug 19 15:31:41.984317 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 457/906] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:41 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:42.607253 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a3ffc832-ff9b-4f6f-9717-ed10e25e0536 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:42.607869 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a3ffc832-ff9b-4f6f-9717-ed10e25e0536 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:42.614346 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3ffc832-ff9b-4f6f-9717-ed10e25e0536 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:42.614829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3ffc832-ff9b-4f6f-9717-ed10e25e0536 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:42.615259 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3ffc832-ff9b-4f6f-9717-ed10e25e0536 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:42.615941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3ffc832-ff9b-4f6f-9717-ed10e25e0536 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:42.616411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3ffc832-ff9b-4f6f-9717-ed10e25e0536 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:42.617363 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3ffc832-ff9b-4f6f-9717-ed10e25e0536 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:42.747256 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a3ffc832-ff9b-4f6f-9717-ed10e25e0536 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:42.754817 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a3ffc832-ff9b-4f6f-9717-ed10e25e0536 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1266 microversion: 2.1 time: 0.151449 Aug 19 15:31:42.755379 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 450/907] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:42 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:43.004508 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b75489c6-7626-48e5-a0bd-0b5f6701ca00 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:43.005040 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b75489c6-7626-48e5-a0bd-0b5f6701ca00 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:43.011453 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b75489c6-7626-48e5-a0bd-0b5f6701ca00 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:43.011930 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b75489c6-7626-48e5-a0bd-0b5f6701ca00 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:43.012376 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b75489c6-7626-48e5-a0bd-0b5f6701ca00 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:43.013097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b75489c6-7626-48e5-a0bd-0b5f6701ca00 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:43.013550 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b75489c6-7626-48e5-a0bd-0b5f6701ca00 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:43.013968 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b75489c6-7626-48e5-a0bd-0b5f6701ca00 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:43.151430 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b75489c6-7626-48e5-a0bd-0b5f6701ca00 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:43.159222 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b75489c6-7626-48e5-a0bd-0b5f6701ca00 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1260 microversion: 2.1 time: 0.158676 Aug 19 15:31:43.159790 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 458/908] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:42 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:43.365561 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-29fe1df9-2d42-4698-a942-c0f15ad436d5 req-cfc1568b-c3b4-4b5c-872a-5bee657d8402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446054b4-8b4f-45ec-9e9b-4a552af02065", "name": "network-vif-plugged", "status": "completed", "tag": "202d895f-8706-4b55-b8a7-80568bae22d1"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:31:43.375276 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-29fe1df9-2d42-4698-a942-c0f15ad436d5 req-cfc1568b-c3b4-4b5c-872a-5bee657d8402 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:43.375777 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-29fe1df9-2d42-4698-a942-c0f15ad436d5 req-cfc1568b-c3b4-4b5c-872a-5bee657d8402 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:43.376195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-29fe1df9-2d42-4698-a942-c0f15ad436d5 req-cfc1568b-c3b4-4b5c-872a-5bee657d8402 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:43.387877 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-29fe1df9-2d42-4698-a942-c0f15ad436d5 req-cfc1568b-c3b4-4b5c-872a-5bee657d8402 service nova] Creating event network-vif-plugged:202d895f-8706-4b55-b8a7-80568bae22d1 for instance 446054b4-8b4f-45ec-9e9b-4a552af02065 on hv-cinder-83538 Aug 19 15:31:43.393241 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-29fe1df9-2d42-4698-a942-c0f15ad436d5 req-cfc1568b-c3b4-4b5c-872a-5bee657d8402 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030874 Aug 19 15:31:43.394073 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 451/909] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:31:43.775966 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-abc625aa-8db3-439b-a8d0-5fbf7d9ce3ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:43.776618 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-abc625aa-8db3-439b-a8d0-5fbf7d9ce3ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:43.783209 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abc625aa-8db3-439b-a8d0-5fbf7d9ce3ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:43.783726 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abc625aa-8db3-439b-a8d0-5fbf7d9ce3ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:43.784418 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abc625aa-8db3-439b-a8d0-5fbf7d9ce3ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:43.785111 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abc625aa-8db3-439b-a8d0-5fbf7d9ce3ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:43.785566 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abc625aa-8db3-439b-a8d0-5fbf7d9ce3ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:43.785988 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abc625aa-8db3-439b-a8d0-5fbf7d9ce3ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:43.927700 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-abc625aa-8db3-439b-a8d0-5fbf7d9ce3ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:43.936053 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-abc625aa-8db3-439b-a8d0-5fbf7d9ce3ac tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1266 microversion: 2.1 time: 0.164808 Aug 19 15:31:43.936672 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 459/910] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:43 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:44.181021 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d623b513-eb2e-4e8a-b8e1-66dc3b1a2b4f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:44.181618 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d623b513-eb2e-4e8a-b8e1-66dc3b1a2b4f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:44.187724 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d623b513-eb2e-4e8a-b8e1-66dc3b1a2b4f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:44.188202 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d623b513-eb2e-4e8a-b8e1-66dc3b1a2b4f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:44.188662 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d623b513-eb2e-4e8a-b8e1-66dc3b1a2b4f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:44.189351 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d623b513-eb2e-4e8a-b8e1-66dc3b1a2b4f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:44.189803 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d623b513-eb2e-4e8a-b8e1-66dc3b1a2b4f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:44.190225 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d623b513-eb2e-4e8a-b8e1-66dc3b1a2b4f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:44.320283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d623b513-eb2e-4e8a-b8e1-66dc3b1a2b4f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:44.328411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d623b513-eb2e-4e8a-b8e1-66dc3b1a2b4f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1260 microversion: 2.1 time: 0.152581 Aug 19 15:31:44.329005 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 452/911] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:44 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:44.957496 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-efb644af-b583-42c0-bb8b-17305fe53c5a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:44.958035 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-efb644af-b583-42c0-bb8b-17305fe53c5a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:44.963954 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efb644af-b583-42c0-bb8b-17305fe53c5a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:44.964463 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efb644af-b583-42c0-bb8b-17305fe53c5a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:44.964900 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efb644af-b583-42c0-bb8b-17305fe53c5a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:44.965584 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efb644af-b583-42c0-bb8b-17305fe53c5a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:44.966042 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efb644af-b583-42c0-bb8b-17305fe53c5a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:44.966464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efb644af-b583-42c0-bb8b-17305fe53c5a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:45.103594 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-efb644af-b583-42c0-bb8b-17305fe53c5a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:45.111711 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-efb644af-b583-42c0-bb8b-17305fe53c5a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1266 microversion: 2.1 time: 0.158185 Aug 19 15:31:45.112431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 460/912] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:44 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:45.349595 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0be964c8-ec62-4083-a8f2-cc69acbef7fa tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:45.350204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0be964c8-ec62-4083-a8f2-cc69acbef7fa tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:45.357402 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0be964c8-ec62-4083-a8f2-cc69acbef7fa tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:45.357885 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0be964c8-ec62-4083-a8f2-cc69acbef7fa tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:45.358321 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0be964c8-ec62-4083-a8f2-cc69acbef7fa tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:45.359013 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0be964c8-ec62-4083-a8f2-cc69acbef7fa tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:45.359465 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0be964c8-ec62-4083-a8f2-cc69acbef7fa tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:45.359889 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0be964c8-ec62-4083-a8f2-cc69acbef7fa tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:45.411700 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-4b8aeb4e-158f-499a-8b8a-913e8497b5d7 req-bf1d0be4-2c5d-4ebf-ba46-9113124bd998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265f2d7d-c0ad-4cc7-bf83-27ea63353ecd", "name": "network-vif-plugged", "status": "completed", "tag": "a4de4f1a-9970-4238-889e-a094171b341d"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:31:45.421425 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4b8aeb4e-158f-499a-8b8a-913e8497b5d7 req-bf1d0be4-2c5d-4ebf-ba46-9113124bd998 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:45.421899 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4b8aeb4e-158f-499a-8b8a-913e8497b5d7 req-bf1d0be4-2c5d-4ebf-ba46-9113124bd998 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:45.422347 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4b8aeb4e-158f-499a-8b8a-913e8497b5d7 req-bf1d0be4-2c5d-4ebf-ba46-9113124bd998 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:45.434744 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-4b8aeb4e-158f-499a-8b8a-913e8497b5d7 req-bf1d0be4-2c5d-4ebf-ba46-9113124bd998 service nova] Creating event network-vif-plugged:a4de4f1a-9970-4238-889e-a094171b341d for instance 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd on hv-cinder-83538 Aug 19 15:31:45.439695 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-4b8aeb4e-158f-499a-8b8a-913e8497b5d7 req-bf1d0be4-2c5d-4ebf-ba46-9113124bd998 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031648 Aug 19 15:31:45.440831 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 461/913] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:31:45.499732 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0be964c8-ec62-4083-a8f2-cc69acbef7fa tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:45.507573 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0be964c8-ec62-4083-a8f2-cc69acbef7fa tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1443 microversion: 2.1 time: 0.162034 Aug 19 15:31:45.508151 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 453/914] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:45 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:45.528793 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6b86c910-7447-4047-b58b-dc0c0472efa1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:45.529487 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6b86c910-7447-4047-b58b-dc0c0472efa1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:45.535627 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b86c910-7447-4047-b58b-dc0c0472efa1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:45.536107 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b86c910-7447-4047-b58b-dc0c0472efa1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:45.536579 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b86c910-7447-4047-b58b-dc0c0472efa1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:45.537272 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b86c910-7447-4047-b58b-dc0c0472efa1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:45.537723 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b86c910-7447-4047-b58b-dc0c0472efa1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:45.538147 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b86c910-7447-4047-b58b-dc0c0472efa1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:45.683877 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6b86c910-7447-4047-b58b-dc0c0472efa1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:45.694349 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6b86c910-7447-4047-b58b-dc0c0472efa1 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1443 microversion: 2.1 time: 0.169751 Aug 19 15:31:45.702424 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 462/915] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:45 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1443 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:46.133170 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1051fcb5-2a0a-4c24-866f-8448fdee0991 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:46.134547 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1051fcb5-2a0a-4c24-866f-8448fdee0991 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:46.142037 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1051fcb5-2a0a-4c24-866f-8448fdee0991 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:46.142630 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1051fcb5-2a0a-4c24-866f-8448fdee0991 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:46.143141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1051fcb5-2a0a-4c24-866f-8448fdee0991 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:46.143984 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1051fcb5-2a0a-4c24-866f-8448fdee0991 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:46.144682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1051fcb5-2a0a-4c24-866f-8448fdee0991 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:46.145185 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1051fcb5-2a0a-4c24-866f-8448fdee0991 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:46.401520 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1051fcb5-2a0a-4c24-866f-8448fdee0991 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:46.417185 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1051fcb5-2a0a-4c24-866f-8448fdee0991 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1266 microversion: 2.1 time: 0.288063 Aug 19 15:31:46.417780 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 454/916] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:46 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:47.439082 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b62eca7b-a26c-44ed-812f-c2aa22765d26 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:47.440452 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b62eca7b-a26c-44ed-812f-c2aa22765d26 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:47.448028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b62eca7b-a26c-44ed-812f-c2aa22765d26 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:47.448537 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b62eca7b-a26c-44ed-812f-c2aa22765d26 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:47.448973 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b62eca7b-a26c-44ed-812f-c2aa22765d26 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:47.449672 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b62eca7b-a26c-44ed-812f-c2aa22765d26 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:47.450153 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b62eca7b-a26c-44ed-812f-c2aa22765d26 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:47.450581 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b62eca7b-a26c-44ed-812f-c2aa22765d26 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:47.894040 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b62eca7b-a26c-44ed-812f-c2aa22765d26 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:47.903830 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b62eca7b-a26c-44ed-812f-c2aa22765d26 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1454 microversion: 2.1 time: 0.468633 Aug 19 15:31:47.904427 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 463/917] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:47 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1454 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:47.924940 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0de49de5-6c81-461e-96f4-033955da925d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:47.925647 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0de49de5-6c81-461e-96f4-033955da925d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:47.933269 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0de49de5-6c81-461e-96f4-033955da925d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:47.933796 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0de49de5-6c81-461e-96f4-033955da925d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:47.934633 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0de49de5-6c81-461e-96f4-033955da925d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:47.935346 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0de49de5-6c81-461e-96f4-033955da925d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:47.935809 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0de49de5-6c81-461e-96f4-033955da925d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:47.936239 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0de49de5-6c81-461e-96f4-033955da925d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:47.975643 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-4dcedf4c-6fbd-4072-adcc-179f1b719ef0 req-f34ac51c-5c82-4c28-b30f-6b4e2ec5f974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "446054b4-8b4f-45ec-9e9b-4a552af02065", "tag": "202d895f-8706-4b55-b8a7-80568bae22d1"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:31:47.986745 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4dcedf4c-6fbd-4072-adcc-179f1b719ef0 req-f34ac51c-5c82-4c28-b30f-6b4e2ec5f974 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:47.987320 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4dcedf4c-6fbd-4072-adcc-179f1b719ef0 req-f34ac51c-5c82-4c28-b30f-6b4e2ec5f974 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:47.987817 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4dcedf4c-6fbd-4072-adcc-179f1b719ef0 req-f34ac51c-5c82-4c28-b30f-6b4e2ec5f974 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:47.999792 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-4dcedf4c-6fbd-4072-adcc-179f1b719ef0 req-f34ac51c-5c82-4c28-b30f-6b4e2ec5f974 service nova] Creating event network-changed:202d895f-8706-4b55-b8a7-80568bae22d1 for instance 446054b4-8b4f-45ec-9e9b-4a552af02065 on hv-cinder-83538 Aug 19 15:31:48.005283 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-4dcedf4c-6fbd-4072-adcc-179f1b719ef0 req-f34ac51c-5c82-4c28-b30f-6b4e2ec5f974 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034194 Aug 19 15:31:48.006082 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 464/918] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:31:48.085544 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0de49de5-6c81-461e-96f4-033955da925d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:48.093943 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0de49de5-6c81-461e-96f4-033955da925d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1454 microversion: 2.1 time: 0.173239 Aug 19 15:31:48.094517 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 455/919] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:31:47 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1454 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:50.066380 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-cf80f52f-8927-4b9e-bd85-08599e90f5f7 req-b46964c2-0b14-409c-a875-bf480da3eb4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "265f2d7d-c0ad-4cc7-bf83-27ea63353ecd", "tag": "a4de4f1a-9970-4238-889e-a094171b341d"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:31:50.076925 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-cf80f52f-8927-4b9e-bd85-08599e90f5f7 req-b46964c2-0b14-409c-a875-bf480da3eb4c service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:50.077483 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-cf80f52f-8927-4b9e-bd85-08599e90f5f7 req-b46964c2-0b14-409c-a875-bf480da3eb4c service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:50.077989 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-cf80f52f-8927-4b9e-bd85-08599e90f5f7 req-b46964c2-0b14-409c-a875-bf480da3eb4c service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:50.081981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:31:50.090356 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-cf80f52f-8927-4b9e-bd85-08599e90f5f7 req-b46964c2-0b14-409c-a875-bf480da3eb4c service nova] Creating event network-changed:a4de4f1a-9970-4238-889e-a094171b341d for instance 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd on hv-cinder-83538 Aug 19 15:31:50.095230 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-cf80f52f-8927-4b9e-bd85-08599e90f5f7 req-b46964c2-0b14-409c-a875-bf480da3eb4c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032864 Aug 19 15:31:50.095899 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 465/920] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:31:57.764135 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a0ca2a5c-6b86-4f32-9216-5da1cd82af0a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:57.764692 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a0ca2a5c-6b86-4f32-9216-5da1cd82af0a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:57.771508 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0ca2a5c-6b86-4f32-9216-5da1cd82af0a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:57.771992 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0ca2a5c-6b86-4f32-9216-5da1cd82af0a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:57.772449 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0ca2a5c-6b86-4f32-9216-5da1cd82af0a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:57.773135 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0ca2a5c-6b86-4f32-9216-5da1cd82af0a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:57.773587 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0ca2a5c-6b86-4f32-9216-5da1cd82af0a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:57.774010 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0ca2a5c-6b86-4f32-9216-5da1cd82af0a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:57.803753 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a0ca2a5c-6b86-4f32-9216-5da1cd82af0a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd/os-volume_attachments/5fcccedc-0f73-40db-903b-d79eef0b8c74" status: 200 len: 194 microversion: 2.20 time: 0.043365 Aug 19 15:31:57.804338 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 456/921] 10.222.0.75 () {60 vars in 1454 bytes} [Fri Aug 19 15:31:57 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd/os-volume_attachments/5fcccedc-0f73-40db-903b-d79eef0b8c74 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 15:31:57.871522 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1ff7f41d-8c8e-4b5c-8b04-54254c98b1f1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:57.872121 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1ff7f41d-8c8e-4b5c-8b04-54254c98b1f1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:57.874062 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:31:57.879699 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ff7f41d-8c8e-4b5c-8b04-54254c98b1f1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:57.880170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ff7f41d-8c8e-4b5c-8b04-54254c98b1f1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:57.880627 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ff7f41d-8c8e-4b5c-8b04-54254c98b1f1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:57.881300 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ff7f41d-8c8e-4b5c-8b04-54254c98b1f1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:57.881746 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ff7f41d-8c8e-4b5c-8b04-54254c98b1f1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:57.882160 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ff7f41d-8c8e-4b5c-8b04-54254c98b1f1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:57.964464 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-1ff7f41d-8c8e-4b5c-8b04-54254c98b1f1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lazy-loading 'services' on Instance uuid 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:31:58.036942 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1ff7f41d-8c8e-4b5c-8b04-54254c98b1f1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "DELETE /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd/os-volume_attachments/5fcccedc-0f73-40db-903b-d79eef0b8c74" status: 202 len: 0 microversion: 2.20 time: 0.170512 Aug 19 15:31:58.037587 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 466/922] 10.222.0.75 () {60 vars in 1457 bytes} [Fri Aug 19 15:31:57 2022] DELETE /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd/os-volume_attachments/5fcccedc-0f73-40db-903b-d79eef0b8c74 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:31:58.046619 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-be6d91d3-a50d-4574-9b46-4abd1fdfc12a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:58.049038 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-be6d91d3-a50d-4574-9b46-4abd1fdfc12a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:58.051279 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:31:58.056409 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be6d91d3-a50d-4574-9b46-4abd1fdfc12a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:58.056975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be6d91d3-a50d-4574-9b46-4abd1fdfc12a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:58.057375 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be6d91d3-a50d-4574-9b46-4abd1fdfc12a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:58.058071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be6d91d3-a50d-4574-9b46-4abd1fdfc12a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:58.058536 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be6d91d3-a50d-4574-9b46-4abd1fdfc12a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:58.059113 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be6d91d3-a50d-4574-9b46-4abd1fdfc12a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:58.062492 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=97 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:31:58.092821 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-be6d91d3-a50d-4574-9b46-4abd1fdfc12a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050224 Aug 19 15:31:58.093395 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 457/923] 10.222.0.75 () {60 vars in 1343 bytes} [Fri Aug 19 15:31:58 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 15:31:59.106333 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e8833d5e-e0d8-4264-8222-a336532b6e97 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:59.108647 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e8833d5e-e0d8-4264-8222-a336532b6e97 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:59.114970 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8833d5e-e0d8-4264-8222-a336532b6e97 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:59.115452 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8833d5e-e0d8-4264-8222-a336532b6e97 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:59.115888 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8833d5e-e0d8-4264-8222-a336532b6e97 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:59.116632 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8833d5e-e0d8-4264-8222-a336532b6e97 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:59.117086 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8833d5e-e0d8-4264-8222-a336532b6e97 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:59.117534 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8833d5e-e0d8-4264-8222-a336532b6e97 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:59.146575 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e8833d5e-e0d8-4264-8222-a336532b6e97 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045740 Aug 19 15:31:59.147134 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 467/924] 10.222.0.75 () {60 vars in 1343 bytes} [Fri Aug 19 15:31:59 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:31:59.209878 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8e7695eb-c122-4f41-9935-c47377f9ef64 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:59.210424 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8e7695eb-c122-4f41-9935-c47377f9ef64 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:59.217124 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e7695eb-c122-4f41-9935-c47377f9ef64 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:59.217606 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e7695eb-c122-4f41-9935-c47377f9ef64 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:59.218061 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e7695eb-c122-4f41-9935-c47377f9ef64 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:59.218737 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e7695eb-c122-4f41-9935-c47377f9ef64 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:59.219184 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e7695eb-c122-4f41-9935-c47377f9ef64 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:59.219601 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e7695eb-c122-4f41-9935-c47377f9ef64 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:59.245004 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8e7695eb-c122-4f41-9935-c47377f9ef64 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:31:59.319216 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8e7695eb-c122-4f41-9935-c47377f9ef64 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "DELETE /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 204 len: 0 microversion: 2.20 time: 0.112898 Aug 19 15:31:59.319840 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 458/925] 10.222.0.75 () {60 vars in 1280 bytes} [Fri Aug 19 15:31:59 2022] DELETE /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 19 15:31:59.328981 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dc766ede-79c9-41b5-ad87-db20b3fb6864 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:31:59.329618 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dc766ede-79c9-41b5-ad87-db20b3fb6864 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:31:59.335487 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc766ede-79c9-41b5-ad87-db20b3fb6864 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:59.335959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc766ede-79c9-41b5-ad87-db20b3fb6864 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:59.336409 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc766ede-79c9-41b5-ad87-db20b3fb6864 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:59.337868 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc766ede-79c9-41b5-ad87-db20b3fb6864 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:31:59.338367 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc766ede-79c9-41b5-ad87-db20b3fb6864 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:31:59.338771 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc766ede-79c9-41b5-ad87-db20b3fb6864 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:31:59.471387 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dc766ede-79c9-41b5-ad87-db20b3fb6864 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:59.479914 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dc766ede-79c9-41b5-ad87-db20b3fb6864 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:59.481418 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dc766ede-79c9-41b5-ad87-db20b3fb6864 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:31:59.482565 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dc766ede-79c9-41b5-ad87-db20b3fb6864 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1722 microversion: 2.20 time: 0.157656 Aug 19 15:31:59.483114 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 468/926] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:31:59 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:32:00.514088 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-386b7c06-7a54-40bf-8eb0-5d3f62f3fbda tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:00.514812 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-386b7c06-7a54-40bf-8eb0-5d3f62f3fbda tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:00.521189 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-386b7c06-7a54-40bf-8eb0-5d3f62f3fbda tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:00.521667 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-386b7c06-7a54-40bf-8eb0-5d3f62f3fbda tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:00.522093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-386b7c06-7a54-40bf-8eb0-5d3f62f3fbda tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:00.522767 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-386b7c06-7a54-40bf-8eb0-5d3f62f3fbda tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:00.523211 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-386b7c06-7a54-40bf-8eb0-5d3f62f3fbda tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:00.523631 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-386b7c06-7a54-40bf-8eb0-5d3f62f3fbda tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:00.657536 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-386b7c06-7a54-40bf-8eb0-5d3f62f3fbda tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:00.666475 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-386b7c06-7a54-40bf-8eb0-5d3f62f3fbda tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:00.667990 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-386b7c06-7a54-40bf-8eb0-5d3f62f3fbda tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:00.669206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-386b7c06-7a54-40bf-8eb0-5d3f62f3fbda tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1722 microversion: 2.20 time: 0.159356 Aug 19 15:32:00.669760 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 459/927] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:32:00 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:32:01.692755 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5bedc94c-94b6-42d5-ad33-6b02814047e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:01.693352 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5bedc94c-94b6-42d5-ad33-6b02814047e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:01.700241 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bedc94c-94b6-42d5-ad33-6b02814047e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:01.700716 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bedc94c-94b6-42d5-ad33-6b02814047e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:01.701157 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bedc94c-94b6-42d5-ad33-6b02814047e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:01.701890 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bedc94c-94b6-42d5-ad33-6b02814047e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:01.702351 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bedc94c-94b6-42d5-ad33-6b02814047e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:01.702777 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5bedc94c-94b6-42d5-ad33-6b02814047e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:01.833713 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5bedc94c-94b6-42d5-ad33-6b02814047e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:01.843732 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5bedc94c-94b6-42d5-ad33-6b02814047e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:01.845324 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5bedc94c-94b6-42d5-ad33-6b02814047e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:01.846470 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5bedc94c-94b6-42d5-ad33-6b02814047e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 200 len: 1722 microversion: 2.20 time: 0.157708 Aug 19 15:32:01.847027 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 469/928] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:32:01 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:32:02.177798 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-f32e23b1-aa7d-410c-bc0d-806e3b49b6c2 req-b8e312fa-411a-4b9e-9447-f20d80a456c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b2c2fe-ead2-4d92-b4fb-dc42b41094fd", "name": "network-vif-deleted", "tag": "5bf9b7d8-d705-4190-bd01-29213ebc351a"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:32:02.191634 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f32e23b1-aa7d-410c-bc0d-806e3b49b6c2 req-b8e312fa-411a-4b9e-9447-f20d80a456c3 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:02.192104 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f32e23b1-aa7d-410c-bc0d-806e3b49b6c2 req-b8e312fa-411a-4b9e-9447-f20d80a456c3 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:02.192571 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f32e23b1-aa7d-410c-bc0d-806e3b49b6c2 req-b8e312fa-411a-4b9e-9447-f20d80a456c3 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:02.206913 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-f32e23b1-aa7d-410c-bc0d-806e3b49b6c2 req-b8e312fa-411a-4b9e-9447-f20d80a456c3 service nova] Creating event network-vif-deleted:5bf9b7d8-d705-4190-bd01-29213ebc351a for instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd on hv-cinder-83538 Aug 19 15:32:02.213535 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-f32e23b1-aa7d-410c-bc0d-806e3b49b6c2 req-b8e312fa-411a-4b9e-9447-f20d80a456c3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037708 Aug 19 15:32:02.214339 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 460/929] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:32:02.870824 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e9545329-ce37-4f78-9ae0-9e948a4d3ad1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:02.871742 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e9545329-ce37-4f78-9ae0-9e948a4d3ad1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:02.878944 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9545329-ce37-4f78-9ae0-9e948a4d3ad1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:02.879430 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9545329-ce37-4f78-9ae0-9e948a4d3ad1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:02.879857 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9545329-ce37-4f78-9ae0-9e948a4d3ad1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:02.880583 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9545329-ce37-4f78-9ae0-9e948a4d3ad1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:02.881060 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9545329-ce37-4f78-9ae0-9e948a4d3ad1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:02.881483 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9545329-ce37-4f78-9ae0-9e948a4d3ad1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:02.898441 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-e9545329-ce37-4f78-9ae0-9e948a4d3ad1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] HTTP exception thrown: Instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd could not be found. Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e9545329-ce37-4f78-9ae0-9e948a4d3ad1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Request method failure captured: Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd HTTP/1.1 Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6xBZR_bfQHg5vENWJDsV2cV3_x9HY76W3WvFBnowNHGN4ZOn0NNRl8CYtVgT7EgMd7GMxuQZc3_bctV8TtO2SOP54nCLHYbRalFYJoQdQjHq6qc3xG3Qzoqs0wYlGIN3tJZhMsy_xC07h5ljHxiXwVxYuojlrEDsnmRaIxAO4QkJJ4 Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Openstack-Nova-Api-Version: 2.20 Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: 981bbb7282bd40d0b5335280d5041fa5 Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2021484624 Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:32:02.900193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:32:02.902128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_981bbb7282bd40d0b5335280d5041fa5", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/981bbb7282bd40d0b5335280d5041fa5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/981bbb7282bd40d0b5335280d5041fa5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/981bbb7282bd40d0b5335280d5041fa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:32:02.902128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2021484624 Aug 19 15:32:02.902128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 981bbb7282bd40d0b5335280d5041fa5 Aug 19 15:32:02.902128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2021484624 Aug 19 15:32:02.902128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeShelveTestJSON-2021484624-project Aug 19 15:32:02.902128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:32:02.902128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:32:02.902128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 821d38464cd3491e81e94d809930d076 Aug 19 15:32:02.902128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2021484624-project Aug 19 15:32:02.902128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:32:02.902128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd could not be found. Aug 19 15:32:02.902128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': '08b2c2fe-ead2-4d92-b4fb-dc42b41094fd'} Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd could not be found. Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:32:02.903058 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:32:02.904509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:32:02.904509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:32:02.904509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:32:02.904509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:32:02.904509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:32:02.904509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:32:02.904509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:32:02.904509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd could not be found. Aug 19 15:32:02.904509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:32:02.904509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:32:02.904509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:32:02.904509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:32:02.904509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:32:02.904509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:32:02.904509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:32:02.904509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:32:02.904509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd could not be found. Aug 19 15:32:02.904509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:32:02.905712 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e9545329-ce37-4f78-9ae0-9e948a4d3ad1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Returning 404 to user: Instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:32:02.905712 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e9545329-ce37-4f78-9ae0-9e948a4d3ad1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 404 len: 111 microversion: 2.20 time: 0.037325 Aug 19 15:32:02.905712 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 470/930] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:32:02 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 19 15:32:02.912362 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cdfffd30-3189-4500-a15c-3fcb1df8ae87 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '.version_select at 0x7fb5334fbf70>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:02.933767 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cdfffd30-3189-4500-a15c-3fcb1df8ae87 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-747024770" status: 204 len: 0 microversion: 2.20 time: 0.025475 Aug 19 15:32:02.934354 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 461/931] 10.222.0.75 () {60 vars in 1259 bytes} [Fri Aug 19 15:32:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-747024770 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 19 15:32:03.600234 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9913c37b-77a3-4aad-80ec-0c39dd88daca tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Action: 'create', calling method: .version_select at 0x7fb5331cdee0>, body: {"keypair": {"name": "tempest-keypair-2078260445", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHX+R90c3XAAIj0rWu0RTLkoCNvZ43+mA++2gjfKnm94P8lyFELg1JcjRn0+9cvYTUQfStPIYXCPpPCzirHc+FaJod791WVoSNh3lPuSq6Y11Oo+ZepxaEgGe9cEJm7MQw=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:32:03.615063 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-9913c37b-77a3-4aad-80ec-0c39dd88daca tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Getting quotas for project 981bbb7282bd40d0b5335280d5041fa5. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:32:03.619294 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-9913c37b-77a3-4aad-80ec-0c39dd88daca tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Getting quotas for user 821d38464cd3491e81e94d809930d076 and project 981bbb7282bd40d0b5335280d5041fa5. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:32:03.644644 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9913c37b-77a3-4aad-80ec-0c39dd88daca tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048290 Aug 19 15:32:03.645251 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 471/932] 10.222.0.75 () {62 vars in 1200 bytes} [Fri Aug 19 15:32:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 19 15:32:05.015320 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ae86324-bd47-49d5-b3f9-de56a122aadc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-765415735", "imageRef": "27174b76-85e7-4123-a2bc-847959ca59f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f06e0ad7-daca-4c6f-af5a-93d063934231"}], "security_groups": [{"name": "tempest-securitygroup--1113220848"}], "key_name": "tempest-keypair-2078260445", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:32:05.119159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-2ae86324-bd47-49d5-b3f9-de56a122aadc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] validate_networks() for [('f06e0ad7-daca-4c6f-af5a-93d063934231', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:32:05.485409 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-2ae86324-bd47-49d5-b3f9-de56a122aadc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:32:05.485860 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-2ae86324-bd47-49d5-b3f9-de56a122aadc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:32:05.486364 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-2ae86324-bd47-49d5-b3f9-de56a122aadc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:32:05.486770 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-2ae86324-bd47-49d5-b3f9-de56a122aadc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:32:05.487181 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-2ae86324-bd47-49d5-b3f9-de56a122aadc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:32:05.497545 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ae86324-bd47-49d5-b3f9-de56a122aadc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:05.498367 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ae86324-bd47-49d5-b3f9-de56a122aadc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:05.499020 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ae86324-bd47-49d5-b3f9-de56a122aadc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:05.499806 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ae86324-bd47-49d5-b3f9-de56a122aadc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:05.500278 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ae86324-bd47-49d5-b3f9-de56a122aadc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:05.500746 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ae86324-bd47-49d5-b3f9-de56a122aadc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:05.518496 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-2ae86324-bd47-49d5-b3f9-de56a122aadc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Getting quotas for project 981bbb7282bd40d0b5335280d5041fa5. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:32:05.522388 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-2ae86324-bd47-49d5-b3f9-de56a122aadc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Getting quotas for user 821d38464cd3491e81e94d809930d076 and project 981bbb7282bd40d0b5335280d5041fa5. Resources: {'ram', 'cores', 'instances'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:32:05.533739 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2ae86324-bd47-49d5-b3f9-de56a122aadc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:32:05.536118 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2ae86324-bd47-49d5-b3f9-de56a122aadc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27174b76-85e7-4123-a2bc-847959ca59f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:32:05.581424 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ae86324-bd47-49d5-b3f9-de56a122aadc tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.570490 Aug 19 15:32:05.582075 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 462/933] 10.222.0.75 () {62 vars in 1188 bytes} [Fri Aug 19 15:32:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 19 15:32:05.594216 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-333209f5-b380-41fa-8485-209f818564cf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:05.594828 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-333209f5-b380-41fa-8485-209f818564cf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:05.648639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-333209f5-b380-41fa-8485-209f818564cf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:05.656836 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-333209f5-b380-41fa-8485-209f818564cf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:05.658340 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-333209f5-b380-41fa-8485-209f818564cf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:05.659473 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-333209f5-b380-41fa-8485-209f818564cf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1281 microversion: 2.20 time: 0.069663 Aug 19 15:32:05.664126 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 472/934] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:32:05 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:32:06.683611 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-75dfa5e5-5894-41d6-a7bb-14984ddbc27c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:06.684616 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-75dfa5e5-5894-41d6-a7bb-14984ddbc27c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:06.691225 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75dfa5e5-5894-41d6-a7bb-14984ddbc27c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:06.691724 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75dfa5e5-5894-41d6-a7bb-14984ddbc27c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:06.692160 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75dfa5e5-5894-41d6-a7bb-14984ddbc27c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:06.692891 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75dfa5e5-5894-41d6-a7bb-14984ddbc27c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:06.693343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75dfa5e5-5894-41d6-a7bb-14984ddbc27c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:06.693767 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75dfa5e5-5894-41d6-a7bb-14984ddbc27c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:06.757677 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-75dfa5e5-5894-41d6-a7bb-14984ddbc27c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:06.765966 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-75dfa5e5-5894-41d6-a7bb-14984ddbc27c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:06.767460 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-75dfa5e5-5894-41d6-a7bb-14984ddbc27c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:06.768592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-75dfa5e5-5894-41d6-a7bb-14984ddbc27c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1339 microversion: 2.20 time: 0.091542 Aug 19 15:32:06.769151 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 463/935] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:32:06 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1339 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:32:07.791893 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-67c7e688-4525-47d2-bb59-a22e1df3c425 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:07.792597 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-67c7e688-4525-47d2-bb59-a22e1df3c425 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:07.798936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67c7e688-4525-47d2-bb59-a22e1df3c425 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:07.799423 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67c7e688-4525-47d2-bb59-a22e1df3c425 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:07.799858 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67c7e688-4525-47d2-bb59-a22e1df3c425 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:07.800593 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67c7e688-4525-47d2-bb59-a22e1df3c425 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:07.801053 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67c7e688-4525-47d2-bb59-a22e1df3c425 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:07.801477 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67c7e688-4525-47d2-bb59-a22e1df3c425 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:07.936989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-2091abe5-2596-4cd0-829c-e9e1458ba042 req-ef01ae79-f5f0-429c-8e8e-3a2e6d4c18eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3f43980-62ff-449e-bcbf-6aef66451613", "tag": "1123119a-1372-416f-b5f1-586c7ed3bbd7"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:32:07.962919 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2091abe5-2596-4cd0-829c-e9e1458ba042 req-ef01ae79-f5f0-429c-8e8e-3a2e6d4c18eb service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:07.964738 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2091abe5-2596-4cd0-829c-e9e1458ba042 req-ef01ae79-f5f0-429c-8e8e-3a2e6d4c18eb service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:07.965427 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2091abe5-2596-4cd0-829c-e9e1458ba042 req-ef01ae79-f5f0-429c-8e8e-3a2e6d4c18eb service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:07.981646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-2091abe5-2596-4cd0-829c-e9e1458ba042 req-ef01ae79-f5f0-429c-8e8e-3a2e6d4c18eb service nova] Creating event network-changed:1123119a-1372-416f-b5f1-586c7ed3bbd7 for instance a3f43980-62ff-449e-bcbf-6aef66451613 on hv-cinder-83538 Aug 19 15:32:07.987032 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-2091abe5-2596-4cd0-829c-e9e1458ba042 req-ef01ae79-f5f0-429c-8e8e-3a2e6d4c18eb service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054109 Aug 19 15:32:07.987786 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 464/936] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:32:08.089066 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67c7e688-4525-47d2-bb59-a22e1df3c425 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:08.097531 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67c7e688-4525-47d2-bb59-a22e1df3c425 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:08.099097 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67c7e688-4525-47d2-bb59-a22e1df3c425 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:08.100193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-67c7e688-4525-47d2-bb59-a22e1df3c425 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1407 microversion: 2.20 time: 0.312968 Aug 19 15:32:08.100791 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 473/937] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:32:07 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 15:32:09.125193 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-63eb1174-e60a-465b-a024-af141956a034 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:09.125913 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-63eb1174-e60a-465b-a024-af141956a034 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:09.134002 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63eb1174-e60a-465b-a024-af141956a034 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:09.134638 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63eb1174-e60a-465b-a024-af141956a034 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:09.135064 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63eb1174-e60a-465b-a024-af141956a034 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:09.136130 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63eb1174-e60a-465b-a024-af141956a034 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:09.136615 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63eb1174-e60a-465b-a024-af141956a034 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:09.137032 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63eb1174-e60a-465b-a024-af141956a034 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:09.265350 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-63eb1174-e60a-465b-a024-af141956a034 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:09.273366 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-63eb1174-e60a-465b-a024-af141956a034 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:09.275071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-63eb1174-e60a-465b-a024-af141956a034 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:09.276181 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-63eb1174-e60a-465b-a024-af141956a034 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1407 microversion: 2.20 time: 0.156048 Aug 19 15:32:09.276790 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 465/938] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:32:09 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 15:32:10.298841 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1f1921a5-06a3-43db-bfb0-e858740aebe7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:10.299436 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1f1921a5-06a3-43db-bfb0-e858740aebe7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:10.306776 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f1921a5-06a3-43db-bfb0-e858740aebe7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:10.307244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f1921a5-06a3-43db-bfb0-e858740aebe7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:10.307667 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f1921a5-06a3-43db-bfb0-e858740aebe7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:10.308339 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f1921a5-06a3-43db-bfb0-e858740aebe7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:10.308809 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f1921a5-06a3-43db-bfb0-e858740aebe7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:10.309224 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1f1921a5-06a3-43db-bfb0-e858740aebe7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:10.441302 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1f1921a5-06a3-43db-bfb0-e858740aebe7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:10.450973 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1f1921a5-06a3-43db-bfb0-e858740aebe7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:10.452530 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1f1921a5-06a3-43db-bfb0-e858740aebe7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:10.453635 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1f1921a5-06a3-43db-bfb0-e858740aebe7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1407 microversion: 2.20 time: 0.158731 Aug 19 15:32:10.454184 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 474/939] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:32:10 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:32:11.475511 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7cf9b46d-a436-4599-b2a3-236e862aa7eb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:11.476113 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7cf9b46d-a436-4599-b2a3-236e862aa7eb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:11.482713 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cf9b46d-a436-4599-b2a3-236e862aa7eb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:11.483200 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cf9b46d-a436-4599-b2a3-236e862aa7eb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:11.483626 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cf9b46d-a436-4599-b2a3-236e862aa7eb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:11.484313 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cf9b46d-a436-4599-b2a3-236e862aa7eb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:11.484788 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cf9b46d-a436-4599-b2a3-236e862aa7eb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:11.485212 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cf9b46d-a436-4599-b2a3-236e862aa7eb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:11.622377 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7cf9b46d-a436-4599-b2a3-236e862aa7eb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:11.631442 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7cf9b46d-a436-4599-b2a3-236e862aa7eb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:11.632964 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7cf9b46d-a436-4599-b2a3-236e862aa7eb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:11.634690 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7cf9b46d-a436-4599-b2a3-236e862aa7eb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1407 microversion: 2.20 time: 0.162944 Aug 19 15:32:11.635346 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 466/940] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:32:11 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:32:12.656357 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9312b8ce-6b43-4317-a136-7e724591813f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:12.657053 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9312b8ce-6b43-4317-a136-7e724591813f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:12.663480 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9312b8ce-6b43-4317-a136-7e724591813f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:12.663960 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9312b8ce-6b43-4317-a136-7e724591813f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:12.664412 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9312b8ce-6b43-4317-a136-7e724591813f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:12.665189 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9312b8ce-6b43-4317-a136-7e724591813f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:12.665686 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9312b8ce-6b43-4317-a136-7e724591813f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:12.666111 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9312b8ce-6b43-4317-a136-7e724591813f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:12.804492 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9312b8ce-6b43-4317-a136-7e724591813f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:12.813480 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9312b8ce-6b43-4317-a136-7e724591813f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:12.815005 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9312b8ce-6b43-4317-a136-7e724591813f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:12.816250 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9312b8ce-6b43-4317-a136-7e724591813f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1407 microversion: 2.20 time: 0.163684 Aug 19 15:32:12.816702 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 475/941] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:32:12 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:32:13.312983 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-4dc4363d-417a-4d71-9a09-17b0118fcd4c req-b071c325-68ce-47b7-92bc-0fce71c5a96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f43980-62ff-449e-bcbf-6aef66451613", "name": "network-vif-plugged", "status": "completed", "tag": "1123119a-1372-416f-b5f1-586c7ed3bbd7"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:32:13.325206 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4dc4363d-417a-4d71-9a09-17b0118fcd4c req-b071c325-68ce-47b7-92bc-0fce71c5a96e service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:13.326138 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4dc4363d-417a-4d71-9a09-17b0118fcd4c req-b071c325-68ce-47b7-92bc-0fce71c5a96e service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:13.326741 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4dc4363d-417a-4d71-9a09-17b0118fcd4c req-b071c325-68ce-47b7-92bc-0fce71c5a96e service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:13.338827 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-4dc4363d-417a-4d71-9a09-17b0118fcd4c req-b071c325-68ce-47b7-92bc-0fce71c5a96e service nova] Creating event network-vif-plugged:1123119a-1372-416f-b5f1-586c7ed3bbd7 for instance a3f43980-62ff-449e-bcbf-6aef66451613 on hv-cinder-83538 Aug 19 15:32:13.343802 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-4dc4363d-417a-4d71-9a09-17b0118fcd4c req-b071c325-68ce-47b7-92bc-0fce71c5a96e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034528 Aug 19 15:32:13.344723 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 467/942] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:32:13.840140 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-20e940bc-93ab-4b3d-b656-2fa3d36dd620 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:13.840799 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-20e940bc-93ab-4b3d-b656-2fa3d36dd620 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:13.847346 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20e940bc-93ab-4b3d-b656-2fa3d36dd620 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:13.847822 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20e940bc-93ab-4b3d-b656-2fa3d36dd620 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:13.848250 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20e940bc-93ab-4b3d-b656-2fa3d36dd620 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:13.848963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20e940bc-93ab-4b3d-b656-2fa3d36dd620 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:13.849409 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20e940bc-93ab-4b3d-b656-2fa3d36dd620 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:13.849842 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20e940bc-93ab-4b3d-b656-2fa3d36dd620 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:13.978897 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-20e940bc-93ab-4b3d-b656-2fa3d36dd620 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:13.986900 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-20e940bc-93ab-4b3d-b656-2fa3d36dd620 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:13.988539 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-20e940bc-93ab-4b3d-b656-2fa3d36dd620 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:13.989625 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-20e940bc-93ab-4b3d-b656-2fa3d36dd620 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1407 microversion: 2.20 time: 0.154616 Aug 19 15:32:13.990165 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 476/943] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:32:13 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:32:15.013401 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b8235ce4-d015-44d8-8066-52850c0681f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:15.014115 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b8235ce4-d015-44d8-8066-52850c0681f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:15.020211 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8235ce4-d015-44d8-8066-52850c0681f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:15.020757 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8235ce4-d015-44d8-8066-52850c0681f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:15.021142 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8235ce4-d015-44d8-8066-52850c0681f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:15.021822 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8235ce4-d015-44d8-8066-52850c0681f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:15.022269 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8235ce4-d015-44d8-8066-52850c0681f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:15.022687 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8235ce4-d015-44d8-8066-52850c0681f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:15.157352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b8235ce4-d015-44d8-8066-52850c0681f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:15.165545 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b8235ce4-d015-44d8-8066-52850c0681f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:15.167039 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b8235ce4-d015-44d8-8066-52850c0681f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:15.168131 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b8235ce4-d015-44d8-8066-52850c0681f5 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1407 microversion: 2.20 time: 0.159596 Aug 19 15:32:15.168720 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 468/944] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:32:15 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:32:16.190667 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a1fd4799-8b46-4adf-babe-fb628d68124d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:16.191292 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a1fd4799-8b46-4adf-babe-fb628d68124d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:16.193433 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=6 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:32:16.198879 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1fd4799-8b46-4adf-babe-fb628d68124d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:16.199391 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1fd4799-8b46-4adf-babe-fb628d68124d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:16.199824 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1fd4799-8b46-4adf-babe-fb628d68124d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:16.200557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1fd4799-8b46-4adf-babe-fb628d68124d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:16.201207 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1fd4799-8b46-4adf-babe-fb628d68124d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:16.201740 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1fd4799-8b46-4adf-babe-fb628d68124d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:16.335225 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a1fd4799-8b46-4adf-babe-fb628d68124d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:16.344078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a1fd4799-8b46-4adf-babe-fb628d68124d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:16.345706 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a1fd4799-8b46-4adf-babe-fb628d68124d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:16.346895 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a1fd4799-8b46-4adf-babe-fb628d68124d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1598 microversion: 2.20 time: 0.160129 Aug 19 15:32:16.347513 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 477/945] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:32:16 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:32:16.368920 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9407b255-f477-4e95-987b-7214f0a9061d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:16.369438 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9407b255-f477-4e95-987b-7214f0a9061d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:16.371337 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:32:16.371991 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:32:16.378633 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9407b255-f477-4e95-987b-7214f0a9061d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:16.379116 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9407b255-f477-4e95-987b-7214f0a9061d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:16.379548 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9407b255-f477-4e95-987b-7214f0a9061d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:16.380239 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9407b255-f477-4e95-987b-7214f0a9061d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:16.380728 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9407b255-f477-4e95-987b-7214f0a9061d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:16.381255 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9407b255-f477-4e95-987b-7214f0a9061d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:16.457425 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9407b255-f477-4e95-987b-7214f0a9061d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092587 Aug 19 15:32:16.458011 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 469/946] 10.222.0.75 () {60 vars in 1316 bytes} [Fri Aug 19 15:32:16 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 15:32:17.397211 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-02ef4b85-fb00-434e-832f-e347ea758842 req-3eae276e-c446-471f-9539-18d6c28f74a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3f43980-62ff-449e-bcbf-6aef66451613", "tag": "1123119a-1372-416f-b5f1-586c7ed3bbd7"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:32:17.407229 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-02ef4b85-fb00-434e-832f-e347ea758842 req-3eae276e-c446-471f-9539-18d6c28f74a4 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:17.407684 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-02ef4b85-fb00-434e-832f-e347ea758842 req-3eae276e-c446-471f-9539-18d6c28f74a4 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:17.408112 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-02ef4b85-fb00-434e-832f-e347ea758842 req-3eae276e-c446-471f-9539-18d6c28f74a4 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:17.419762 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-02ef4b85-fb00-434e-832f-e347ea758842 req-3eae276e-c446-471f-9539-18d6c28f74a4 service nova] Creating event network-changed:1123119a-1372-416f-b5f1-586c7ed3bbd7 for instance a3f43980-62ff-449e-bcbf-6aef66451613 on hv-cinder-83538 Aug 19 15:32:17.424923 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-02ef4b85-fb00-434e-832f-e347ea758842 req-3eae276e-c446-471f-9539-18d6c28f74a4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031468 Aug 19 15:32:17.425552 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 478/947] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:32:53.462169 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:32:53.463015 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:32:53.467372 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b9e52a49-fc47-4864-b61c-94904d33f1a1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:53.467853 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b9e52a49-fc47-4864-b61c-94904d33f1a1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:53.475045 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9e52a49-fc47-4864-b61c-94904d33f1a1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:53.475516 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9e52a49-fc47-4864-b61c-94904d33f1a1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:53.475943 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9e52a49-fc47-4864-b61c-94904d33f1a1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:53.476642 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9e52a49-fc47-4864-b61c-94904d33f1a1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:53.477295 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9e52a49-fc47-4864-b61c-94904d33f1a1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:53.477490 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9e52a49-fc47-4864-b61c-94904d33f1a1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:53.504681 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b9e52a49-fc47-4864-b61c-94904d33f1a1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613/ips" status: 200 len: 150 microversion: 2.20 time: 0.043797 Aug 19 15:32:53.505258 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 470/948] 10.222.0.75 () {60 vars in 1289 bytes} [Fri Aug 19 15:32:53 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 15:32:56.510176 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:32:56.510948 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:32:56.515974 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cb3f6dac-c268-4ceb-a572-493129857754 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:32:56.516658 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cb3f6dac-c268-4ceb-a572-493129857754 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:56.524085 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb3f6dac-c268-4ceb-a572-493129857754 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:56.524605 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb3f6dac-c268-4ceb-a572-493129857754 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:56.525033 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb3f6dac-c268-4ceb-a572-493129857754 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:56.525726 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb3f6dac-c268-4ceb-a572-493129857754 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:56.526177 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb3f6dac-c268-4ceb-a572-493129857754 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:56.526599 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb3f6dac-c268-4ceb-a572-493129857754 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:56.550400 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-cb3f6dac-c268-4ceb-a572-493129857754 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lazy-loading 'flavor' on Instance uuid a3f43980-62ff-449e-bcbf-6aef66451613 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:32:56.725950 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cb3f6dac-c268-4ceb-a572-493129857754 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "POST /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613/action" status: 202 len: 0 microversion: 2.20 time: 0.217369 Aug 19 15:32:56.726568 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 479/949] 10.222.0.75 () {62 vars in 1319 bytes} [Fri Aug 19 15:32:56 2022] POST /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:32:56.735297 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1210ce93-3510-4647-9014-d39ba1cf5c2e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:56.735911 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1210ce93-3510-4647-9014-d39ba1cf5c2e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:56.742021 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1210ce93-3510-4647-9014-d39ba1cf5c2e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:56.742503 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1210ce93-3510-4647-9014-d39ba1cf5c2e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:56.742941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1210ce93-3510-4647-9014-d39ba1cf5c2e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:56.743629 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1210ce93-3510-4647-9014-d39ba1cf5c2e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:56.744082 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1210ce93-3510-4647-9014-d39ba1cf5c2e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:56.744539 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1210ce93-3510-4647-9014-d39ba1cf5c2e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:56.877950 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1210ce93-3510-4647-9014-d39ba1cf5c2e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:56.886393 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1210ce93-3510-4647-9014-d39ba1cf5c2e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:56.887940 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1210ce93-3510-4647-9014-d39ba1cf5c2e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:56.889127 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1210ce93-3510-4647-9014-d39ba1cf5c2e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1722 microversion: 2.20 time: 0.158433 Aug 19 15:32:56.889683 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 471/950] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:32:56 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:32:57.913191 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-54f333e4-7707-4e89-a5f8-05e62137a715 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:57.913910 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-54f333e4-7707-4e89-a5f8-05e62137a715 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:57.922998 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54f333e4-7707-4e89-a5f8-05e62137a715 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:57.923475 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54f333e4-7707-4e89-a5f8-05e62137a715 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:57.923905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54f333e4-7707-4e89-a5f8-05e62137a715 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:57.924619 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54f333e4-7707-4e89-a5f8-05e62137a715 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:57.925072 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54f333e4-7707-4e89-a5f8-05e62137a715 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:57.925490 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54f333e4-7707-4e89-a5f8-05e62137a715 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:58.057615 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-54f333e4-7707-4e89-a5f8-05e62137a715 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:58.066014 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-54f333e4-7707-4e89-a5f8-05e62137a715 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:58.067512 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-54f333e4-7707-4e89-a5f8-05e62137a715 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:58.068764 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-54f333e4-7707-4e89-a5f8-05e62137a715 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1722 microversion: 2.20 time: 0.160280 Aug 19 15:32:58.069322 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 480/951] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:32:57 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:32:59.092482 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4a6e5989-b65a-4be9-8acd-ad6da45c74d3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:32:59.093089 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4a6e5989-b65a-4be9-8acd-ad6da45c74d3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:32:59.099491 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a6e5989-b65a-4be9-8acd-ad6da45c74d3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:59.099967 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a6e5989-b65a-4be9-8acd-ad6da45c74d3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:59.100422 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a6e5989-b65a-4be9-8acd-ad6da45c74d3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:59.101101 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a6e5989-b65a-4be9-8acd-ad6da45c74d3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:32:59.101551 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a6e5989-b65a-4be9-8acd-ad6da45c74d3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:32:59.101970 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a6e5989-b65a-4be9-8acd-ad6da45c74d3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:32:59.232584 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4a6e5989-b65a-4be9-8acd-ad6da45c74d3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:59.240850 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4a6e5989-b65a-4be9-8acd-ad6da45c74d3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:59.242519 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4a6e5989-b65a-4be9-8acd-ad6da45c74d3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:32:59.243702 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4a6e5989-b65a-4be9-8acd-ad6da45c74d3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1722 microversion: 2.20 time: 0.155818 Aug 19 15:32:59.244288 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 472/952] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:32:59 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:00.266969 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b7add7ef-a2a5-49fb-8b6d-3a92dc548b42 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:00.267609 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b7add7ef-a2a5-49fb-8b6d-3a92dc548b42 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:00.274080 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7add7ef-a2a5-49fb-8b6d-3a92dc548b42 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:00.274559 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7add7ef-a2a5-49fb-8b6d-3a92dc548b42 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:00.274990 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7add7ef-a2a5-49fb-8b6d-3a92dc548b42 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:00.275673 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7add7ef-a2a5-49fb-8b6d-3a92dc548b42 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:00.276120 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7add7ef-a2a5-49fb-8b6d-3a92dc548b42 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:00.276572 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7add7ef-a2a5-49fb-8b6d-3a92dc548b42 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:00.404254 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b7add7ef-a2a5-49fb-8b6d-3a92dc548b42 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:00.412307 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b7add7ef-a2a5-49fb-8b6d-3a92dc548b42 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:00.413829 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b7add7ef-a2a5-49fb-8b6d-3a92dc548b42 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:00.414967 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b7add7ef-a2a5-49fb-8b6d-3a92dc548b42 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1722 microversion: 2.20 time: 0.152799 Aug 19 15:33:00.415515 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 481/953] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:00 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:01.437566 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-442c1e2c-e8a0-4f29-804a-822fbfd71033 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:01.438182 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-442c1e2c-e8a0-4f29-804a-822fbfd71033 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:01.444773 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-442c1e2c-e8a0-4f29-804a-822fbfd71033 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:01.445252 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-442c1e2c-e8a0-4f29-804a-822fbfd71033 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:01.445682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-442c1e2c-e8a0-4f29-804a-822fbfd71033 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:01.446360 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-442c1e2c-e8a0-4f29-804a-822fbfd71033 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:01.446811 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-442c1e2c-e8a0-4f29-804a-822fbfd71033 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:01.447230 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-442c1e2c-e8a0-4f29-804a-822fbfd71033 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:01.577865 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-442c1e2c-e8a0-4f29-804a-822fbfd71033 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:01.586218 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-442c1e2c-e8a0-4f29-804a-822fbfd71033 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:01.587721 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-442c1e2c-e8a0-4f29-804a-822fbfd71033 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:01.588911 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-442c1e2c-e8a0-4f29-804a-822fbfd71033 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1722 microversion: 2.20 time: 0.155282 Aug 19 15:33:01.589483 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 473/954] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:01 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:02.612373 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f490e030-ce64-4517-b4cf-0e95706a0cfd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:02.613102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f490e030-ce64-4517-b4cf-0e95706a0cfd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:02.619425 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f490e030-ce64-4517-b4cf-0e95706a0cfd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:02.619899 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f490e030-ce64-4517-b4cf-0e95706a0cfd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:02.620322 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f490e030-ce64-4517-b4cf-0e95706a0cfd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:02.621023 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f490e030-ce64-4517-b4cf-0e95706a0cfd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:02.621463 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f490e030-ce64-4517-b4cf-0e95706a0cfd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:02.621880 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f490e030-ce64-4517-b4cf-0e95706a0cfd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:02.876769 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f490e030-ce64-4517-b4cf-0e95706a0cfd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:02.886363 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f490e030-ce64-4517-b4cf-0e95706a0cfd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:02.887942 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f490e030-ce64-4517-b4cf-0e95706a0cfd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:02.889218 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f490e030-ce64-4517-b4cf-0e95706a0cfd tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1722 microversion: 2.20 time: 0.280754 Aug 19 15:33:02.892454 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 482/955] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:02 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1722 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:03.913816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-229d034d-91c0-4c2f-937c-b25ff5fc0727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:03.914401 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-229d034d-91c0-4c2f-937c-b25ff5fc0727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:03.920834 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-229d034d-91c0-4c2f-937c-b25ff5fc0727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:03.921305 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-229d034d-91c0-4c2f-937c-b25ff5fc0727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:03.921730 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-229d034d-91c0-4c2f-937c-b25ff5fc0727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:03.922401 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-229d034d-91c0-4c2f-937c-b25ff5fc0727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:03.922846 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-229d034d-91c0-4c2f-937c-b25ff5fc0727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:03.923260 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-229d034d-91c0-4c2f-937c-b25ff5fc0727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:04.056694 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-229d034d-91c0-4c2f-937c-b25ff5fc0727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:04.065592 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-229d034d-91c0-4c2f-937c-b25ff5fc0727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:04.067181 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-229d034d-91c0-4c2f-937c-b25ff5fc0727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:04.068787 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-229d034d-91c0-4c2f-937c-b25ff5fc0727 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1722 microversion: 2.20 time: 0.159024 Aug 19 15:33:04.069351 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 474/956] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:03 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:05.092848 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-96d656c0-abf7-4838-b92c-618f23946731 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:05.093596 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-96d656c0-abf7-4838-b92c-618f23946731 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:05.099991 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96d656c0-abf7-4838-b92c-618f23946731 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:05.100502 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96d656c0-abf7-4838-b92c-618f23946731 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:05.100935 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96d656c0-abf7-4838-b92c-618f23946731 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:05.101621 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96d656c0-abf7-4838-b92c-618f23946731 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:05.102070 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96d656c0-abf7-4838-b92c-618f23946731 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:05.102503 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96d656c0-abf7-4838-b92c-618f23946731 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:05.229360 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-96d656c0-abf7-4838-b92c-618f23946731 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:05.238131 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-96d656c0-abf7-4838-b92c-618f23946731 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:05.239633 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-96d656c0-abf7-4838-b92c-618f23946731 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:05.240803 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-96d656c0-abf7-4838-b92c-618f23946731 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1722 microversion: 2.20 time: 0.152468 Aug 19 15:33:05.241350 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 483/957] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:05 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:06.263472 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8dc462ef-809b-4bfe-bee9-fe1488d5c818 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:06.264088 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8dc462ef-809b-4bfe-bee9-fe1488d5c818 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:06.271477 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dc462ef-809b-4bfe-bee9-fe1488d5c818 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:06.271899 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dc462ef-809b-4bfe-bee9-fe1488d5c818 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:06.272322 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dc462ef-809b-4bfe-bee9-fe1488d5c818 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:06.273019 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dc462ef-809b-4bfe-bee9-fe1488d5c818 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:06.273464 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dc462ef-809b-4bfe-bee9-fe1488d5c818 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:06.273876 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dc462ef-809b-4bfe-bee9-fe1488d5c818 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:06.455794 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8dc462ef-809b-4bfe-bee9-fe1488d5c818 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:06.464208 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8dc462ef-809b-4bfe-bee9-fe1488d5c818 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:06.465897 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8dc462ef-809b-4bfe-bee9-fe1488d5c818 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:06.467065 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8dc462ef-809b-4bfe-bee9-fe1488d5c818 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1722 microversion: 2.20 time: 0.207551 Aug 19 15:33:06.467660 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 475/958] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:06 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:07.490021 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cb85c812-16ad-46a7-bf4c-156aafc8acfa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:07.490651 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cb85c812-16ad-46a7-bf4c-156aafc8acfa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:07.497273 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb85c812-16ad-46a7-bf4c-156aafc8acfa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:07.497758 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb85c812-16ad-46a7-bf4c-156aafc8acfa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:07.498216 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb85c812-16ad-46a7-bf4c-156aafc8acfa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:07.498903 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb85c812-16ad-46a7-bf4c-156aafc8acfa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:07.499461 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb85c812-16ad-46a7-bf4c-156aafc8acfa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:07.499888 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb85c812-16ad-46a7-bf4c-156aafc8acfa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:07.627140 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cb85c812-16ad-46a7-bf4c-156aafc8acfa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:07.635336 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cb85c812-16ad-46a7-bf4c-156aafc8acfa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:07.636893 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cb85c812-16ad-46a7-bf4c-156aafc8acfa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:07.638130 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cb85c812-16ad-46a7-bf4c-156aafc8acfa tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1743 microversion: 2.20 time: 0.152076 Aug 19 15:33:07.638684 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 484/959] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:07 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:08.662071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-766b1357-b3ed-4be3-aeec-9b40d9fdf44f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:08.662661 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-766b1357-b3ed-4be3-aeec-9b40d9fdf44f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:08.669081 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-766b1357-b3ed-4be3-aeec-9b40d9fdf44f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:08.669569 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-766b1357-b3ed-4be3-aeec-9b40d9fdf44f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:08.669998 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-766b1357-b3ed-4be3-aeec-9b40d9fdf44f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:08.671384 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-766b1357-b3ed-4be3-aeec-9b40d9fdf44f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:08.671867 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-766b1357-b3ed-4be3-aeec-9b40d9fdf44f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:08.672293 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-766b1357-b3ed-4be3-aeec-9b40d9fdf44f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:08.799574 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-766b1357-b3ed-4be3-aeec-9b40d9fdf44f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:08.807861 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-766b1357-b3ed-4be3-aeec-9b40d9fdf44f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:08.809390 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-766b1357-b3ed-4be3-aeec-9b40d9fdf44f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:08.810538 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-766b1357-b3ed-4be3-aeec-9b40d9fdf44f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1743 microversion: 2.20 time: 0.152428 Aug 19 15:33:08.811605 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 476/960] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:08 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:09.834183 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ba878716-259b-49ae-bcf2-d4f3a63fc012 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:09.834854 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ba878716-259b-49ae-bcf2-d4f3a63fc012 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:09.841485 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba878716-259b-49ae-bcf2-d4f3a63fc012 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:09.841974 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba878716-259b-49ae-bcf2-d4f3a63fc012 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:09.842467 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba878716-259b-49ae-bcf2-d4f3a63fc012 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:09.843925 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba878716-259b-49ae-bcf2-d4f3a63fc012 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:09.844586 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba878716-259b-49ae-bcf2-d4f3a63fc012 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:09.845070 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba878716-259b-49ae-bcf2-d4f3a63fc012 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:09.984310 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ba878716-259b-49ae-bcf2-d4f3a63fc012 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:09.992438 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ba878716-259b-49ae-bcf2-d4f3a63fc012 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:09.993929 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ba878716-259b-49ae-bcf2-d4f3a63fc012 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:09.995075 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ba878716-259b-49ae-bcf2-d4f3a63fc012 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1738 microversion: 2.20 time: 0.164850 Aug 19 15:33:09.995621 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 485/961] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:09 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:11.019322 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e8f529b6-c11b-416e-b95b-84fae79cb1c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:11.019929 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e8f529b6-c11b-416e-b95b-84fae79cb1c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:11.026335 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8f529b6-c11b-416e-b95b-84fae79cb1c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:11.027115 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8f529b6-c11b-416e-b95b-84fae79cb1c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:11.030656 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8f529b6-c11b-416e-b95b-84fae79cb1c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:11.031462 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8f529b6-c11b-416e-b95b-84fae79cb1c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:11.031928 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8f529b6-c11b-416e-b95b-84fae79cb1c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:11.032354 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8f529b6-c11b-416e-b95b-84fae79cb1c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:11.177975 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e8f529b6-c11b-416e-b95b-84fae79cb1c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:11.186788 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e8f529b6-c11b-416e-b95b-84fae79cb1c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:11.188685 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e8f529b6-c11b-416e-b95b-84fae79cb1c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:11.189864 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e8f529b6-c11b-416e-b95b-84fae79cb1c1 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1738 microversion: 2.20 time: 0.174551 Aug 19 15:33:11.190419 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 477/962] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:11 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:11.616592 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-4a5acaeb-8aa8-4627-92aa-82a40d56a469 req-232fd657-8b78-4490-b233-79e731d5ee2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f43980-62ff-449e-bcbf-6aef66451613", "name": "network-vif-plugged", "status": "completed", "tag": "1123119a-1372-416f-b5f1-586c7ed3bbd7"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:33:11.630402 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4a5acaeb-8aa8-4627-92aa-82a40d56a469 req-232fd657-8b78-4490-b233-79e731d5ee2a service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:11.631010 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4a5acaeb-8aa8-4627-92aa-82a40d56a469 req-232fd657-8b78-4490-b233-79e731d5ee2a service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:11.631862 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4a5acaeb-8aa8-4627-92aa-82a40d56a469 req-232fd657-8b78-4490-b233-79e731d5ee2a service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:11.652277 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-4a5acaeb-8aa8-4627-92aa-82a40d56a469 req-232fd657-8b78-4490-b233-79e731d5ee2a service nova] Creating event network-vif-plugged:1123119a-1372-416f-b5f1-586c7ed3bbd7 for instance a3f43980-62ff-449e-bcbf-6aef66451613 on hv-cinder-83538 Aug 19 15:33:11.658450 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-4a5acaeb-8aa8-4627-92aa-82a40d56a469 req-232fd657-8b78-4490-b233-79e731d5ee2a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045505 Aug 19 15:33:11.659146 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 486/963] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:33:12.213558 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c1214661-126e-4fbe-b138-9bfe962e4dab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:12.214155 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c1214661-126e-4fbe-b138-9bfe962e4dab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:12.221220 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1214661-126e-4fbe-b138-9bfe962e4dab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:12.221712 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1214661-126e-4fbe-b138-9bfe962e4dab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:12.222143 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1214661-126e-4fbe-b138-9bfe962e4dab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:12.222839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1214661-126e-4fbe-b138-9bfe962e4dab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:12.223286 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1214661-126e-4fbe-b138-9bfe962e4dab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:12.223703 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1214661-126e-4fbe-b138-9bfe962e4dab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:12.370583 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c1214661-126e-4fbe-b138-9bfe962e4dab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:12.379521 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c1214661-126e-4fbe-b138-9bfe962e4dab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:12.381090 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c1214661-126e-4fbe-b138-9bfe962e4dab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:12.382253 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c1214661-126e-4fbe-b138-9bfe962e4dab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1738 microversion: 2.20 time: 0.172764 Aug 19 15:33:12.388456 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 478/964] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:12 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:13.408274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dfccf75b-645a-460c-89fd-a736a100a326 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:13.409380 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dfccf75b-645a-460c-89fd-a736a100a326 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:13.418260 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfccf75b-645a-460c-89fd-a736a100a326 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:13.419607 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfccf75b-645a-460c-89fd-a736a100a326 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:13.421364 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfccf75b-645a-460c-89fd-a736a100a326 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:13.426339 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfccf75b-645a-460c-89fd-a736a100a326 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:13.427539 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfccf75b-645a-460c-89fd-a736a100a326 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:13.428237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfccf75b-645a-460c-89fd-a736a100a326 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:13.594285 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dfccf75b-645a-460c-89fd-a736a100a326 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:13.602924 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dfccf75b-645a-460c-89fd-a736a100a326 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:13.604437 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dfccf75b-645a-460c-89fd-a736a100a326 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:13.605605 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dfccf75b-645a-460c-89fd-a736a100a326 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1738 microversion: 2.20 time: 0.202684 Aug 19 15:33:13.606472 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 487/965] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:13 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:14.630450 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1ef11175-411f-4f7d-a8cd-1f1bc0da53af tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:14.631047 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1ef11175-411f-4f7d-a8cd-1f1bc0da53af tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:14.650500 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ef11175-411f-4f7d-a8cd-1f1bc0da53af tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:14.651059 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ef11175-411f-4f7d-a8cd-1f1bc0da53af tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:14.651491 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ef11175-411f-4f7d-a8cd-1f1bc0da53af tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:14.652814 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ef11175-411f-4f7d-a8cd-1f1bc0da53af tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:14.653285 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ef11175-411f-4f7d-a8cd-1f1bc0da53af tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:14.653678 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ef11175-411f-4f7d-a8cd-1f1bc0da53af tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:14.822140 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1ef11175-411f-4f7d-a8cd-1f1bc0da53af tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:14.834848 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1ef11175-411f-4f7d-a8cd-1f1bc0da53af tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:14.838173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1ef11175-411f-4f7d-a8cd-1f1bc0da53af tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:14.839411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1ef11175-411f-4f7d-a8cd-1f1bc0da53af tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1738 microversion: 2.20 time: 0.212875 Aug 19 15:33:14.840366 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 479/966] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:14 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:15.867768 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ea873f4c-e296-40b3-b4b0-fce019361b06 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:15.868372 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ea873f4c-e296-40b3-b4b0-fce019361b06 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:15.874649 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea873f4c-e296-40b3-b4b0-fce019361b06 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:15.875117 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea873f4c-e296-40b3-b4b0-fce019361b06 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:15.875813 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea873f4c-e296-40b3-b4b0-fce019361b06 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:15.876601 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea873f4c-e296-40b3-b4b0-fce019361b06 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:15.877346 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea873f4c-e296-40b3-b4b0-fce019361b06 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:15.877961 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea873f4c-e296-40b3-b4b0-fce019361b06 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:16.033688 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ea873f4c-e296-40b3-b4b0-fce019361b06 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:16.043551 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ea873f4c-e296-40b3-b4b0-fce019361b06 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:16.045077 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ea873f4c-e296-40b3-b4b0-fce019361b06 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:16.046432 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ea873f4c-e296-40b3-b4b0-fce019361b06 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1738 microversion: 2.20 time: 0.183987 Aug 19 15:33:16.055644 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 488/967] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:15 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:17.070934 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e00a4ab8-5993-479b-878b-56e889d323c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:17.071563 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e00a4ab8-5993-479b-878b-56e889d323c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:17.086434 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e00a4ab8-5993-479b-878b-56e889d323c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:17.088276 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e00a4ab8-5993-479b-878b-56e889d323c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:17.090118 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e00a4ab8-5993-479b-878b-56e889d323c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:17.093129 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e00a4ab8-5993-479b-878b-56e889d323c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:17.093682 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e00a4ab8-5993-479b-878b-56e889d323c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:17.094229 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e00a4ab8-5993-479b-878b-56e889d323c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:17.247378 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e00a4ab8-5993-479b-878b-56e889d323c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:17.258828 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e00a4ab8-5993-479b-878b-56e889d323c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:17.260497 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e00a4ab8-5993-479b-878b-56e889d323c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:17.261675 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e00a4ab8-5993-479b-878b-56e889d323c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1738 microversion: 2.20 time: 0.194659 Aug 19 15:33:17.262445 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 480/968] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:17 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:18.287181 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3234e1f5-f6b6-48bb-980b-3ea5b637a954 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:18.287913 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3234e1f5-f6b6-48bb-980b-3ea5b637a954 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:18.294882 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3234e1f5-f6b6-48bb-980b-3ea5b637a954 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:18.296320 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3234e1f5-f6b6-48bb-980b-3ea5b637a954 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:18.297266 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3234e1f5-f6b6-48bb-980b-3ea5b637a954 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:18.298579 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3234e1f5-f6b6-48bb-980b-3ea5b637a954 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:18.299296 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3234e1f5-f6b6-48bb-980b-3ea5b637a954 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:18.299719 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3234e1f5-f6b6-48bb-980b-3ea5b637a954 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:18.712637 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3234e1f5-f6b6-48bb-980b-3ea5b637a954 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:18.723330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3234e1f5-f6b6-48bb-980b-3ea5b637a954 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:18.724995 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3234e1f5-f6b6-48bb-980b-3ea5b637a954 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:18.726159 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3234e1f5-f6b6-48bb-980b-3ea5b637a954 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1738 microversion: 2.20 time: 0.443020 Aug 19 15:33:18.726712 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 489/969] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:18 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1738 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:19.750275 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e58201c4-5728-493a-bd1b-c5cc347277c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:19.750841 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e58201c4-5728-493a-bd1b-c5cc347277c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:19.757337 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e58201c4-5728-493a-bd1b-c5cc347277c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:19.757822 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e58201c4-5728-493a-bd1b-c5cc347277c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:19.758247 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e58201c4-5728-493a-bd1b-c5cc347277c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:19.758928 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e58201c4-5728-493a-bd1b-c5cc347277c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:19.759370 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e58201c4-5728-493a-bd1b-c5cc347277c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:19.759781 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e58201c4-5728-493a-bd1b-c5cc347277c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:19.899275 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e58201c4-5728-493a-bd1b-c5cc347277c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:19.908116 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e58201c4-5728-493a-bd1b-c5cc347277c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:19.909660 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e58201c4-5728-493a-bd1b-c5cc347277c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:19.910843 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e58201c4-5728-493a-bd1b-c5cc347277c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1720 microversion: 2.20 time: 0.165865 Aug 19 15:33:19.911406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 481/970] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:19 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:20.934377 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-53cecac2-1aef-46be-abe9-b467fd305ecb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:20.934916 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-53cecac2-1aef-46be-abe9-b467fd305ecb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:20.941999 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53cecac2-1aef-46be-abe9-b467fd305ecb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:20.942477 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53cecac2-1aef-46be-abe9-b467fd305ecb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:20.942937 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53cecac2-1aef-46be-abe9-b467fd305ecb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:20.943622 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53cecac2-1aef-46be-abe9-b467fd305ecb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:20.944073 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53cecac2-1aef-46be-abe9-b467fd305ecb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:20.944522 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53cecac2-1aef-46be-abe9-b467fd305ecb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:21.075275 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-53cecac2-1aef-46be-abe9-b467fd305ecb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:21.083609 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-53cecac2-1aef-46be-abe9-b467fd305ecb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:21.085152 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-53cecac2-1aef-46be-abe9-b467fd305ecb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:21.086315 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-53cecac2-1aef-46be-abe9-b467fd305ecb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1720 microversion: 2.20 time: 0.155932 Aug 19 15:33:21.086869 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 490/971] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:20 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:22.109224 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2dba1627-9466-48e2-bdcc-44454f5e0ba9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:22.109839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2dba1627-9466-48e2-bdcc-44454f5e0ba9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:22.117121 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dba1627-9466-48e2-bdcc-44454f5e0ba9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:22.117605 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dba1627-9466-48e2-bdcc-44454f5e0ba9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:22.118041 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dba1627-9466-48e2-bdcc-44454f5e0ba9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:22.118728 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dba1627-9466-48e2-bdcc-44454f5e0ba9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:22.119183 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dba1627-9466-48e2-bdcc-44454f5e0ba9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:22.119604 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dba1627-9466-48e2-bdcc-44454f5e0ba9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:22.254721 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2dba1627-9466-48e2-bdcc-44454f5e0ba9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:22.262789 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2dba1627-9466-48e2-bdcc-44454f5e0ba9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:22.264462 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2dba1627-9466-48e2-bdcc-44454f5e0ba9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:22.265468 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2dba1627-9466-48e2-bdcc-44454f5e0ba9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1720 microversion: 2.20 time: 0.160237 Aug 19 15:33:22.266027 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 482/972] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:22 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:23.289920 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-52a8a9c6-262d-4c37-b6db-e95b8220b2c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:23.290525 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-52a8a9c6-262d-4c37-b6db-e95b8220b2c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:23.296966 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52a8a9c6-262d-4c37-b6db-e95b8220b2c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:23.297444 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52a8a9c6-262d-4c37-b6db-e95b8220b2c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:23.297874 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52a8a9c6-262d-4c37-b6db-e95b8220b2c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:23.298613 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52a8a9c6-262d-4c37-b6db-e95b8220b2c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:23.299055 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52a8a9c6-262d-4c37-b6db-e95b8220b2c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:23.299477 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52a8a9c6-262d-4c37-b6db-e95b8220b2c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:23.425847 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-52a8a9c6-262d-4c37-b6db-e95b8220b2c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:23.434374 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-52a8a9c6-262d-4c37-b6db-e95b8220b2c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:23.435905 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-52a8a9c6-262d-4c37-b6db-e95b8220b2c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:23.437095 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-52a8a9c6-262d-4c37-b6db-e95b8220b2c9 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1663 microversion: 2.20 time: 0.151158 Aug 19 15:33:23.437646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 491/973] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:23 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:23.459805 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-085b828c-5ccb-4d07-8faa-4989d3f0a231 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e84446f2-b5cd-4f7e-946c-8d071dde3126"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:33:23.462136 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-085b828c-5ccb-4d07-8faa-4989d3f0a231 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:23.468362 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-085b828c-5ccb-4d07-8faa-4989d3f0a231 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:23.468863 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-085b828c-5ccb-4d07-8faa-4989d3f0a231 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:23.469284 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-085b828c-5ccb-4d07-8faa-4989d3f0a231 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:23.469958 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-085b828c-5ccb-4d07-8faa-4989d3f0a231 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:23.471016 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-085b828c-5ccb-4d07-8faa-4989d3f0a231 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:23.471462 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-085b828c-5ccb-4d07-8faa-4989d3f0a231 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:23.544917 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=81 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:33:23.610717 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-5166b64d-7f8a-4d29-8508-971e4f703375 req-39e6cda3-e4cd-45b0-abaf-ea4c6cb1be65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f43980-62ff-449e-bcbf-6aef66451613", "name": "network-vif-unplugged", "status": "completed", "tag": "1123119a-1372-416f-b5f1-586c7ed3bbd7"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:33:23.620219 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-5166b64d-7f8a-4d29-8508-971e4f703375 req-39e6cda3-e4cd-45b0-abaf-ea4c6cb1be65 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:23.620934 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-5166b64d-7f8a-4d29-8508-971e4f703375 req-39e6cda3-e4cd-45b0-abaf-ea4c6cb1be65 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:23.621536 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-5166b64d-7f8a-4d29-8508-971e4f703375 req-39e6cda3-e4cd-45b0-abaf-ea4c6cb1be65 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:23.634545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.compute.server_external_events [req-5166b64d-7f8a-4d29-8508-971e4f703375 req-39e6cda3-e4cd-45b0-abaf-ea4c6cb1be65 service nova] Unable to find a host for instance a3f43980-62ff-449e-bcbf-6aef66451613. Dropping event network-vif-unplugged {{(pid=120638) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 19 15:33:23.635979 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-5166b64d-7f8a-4d29-8508-971e4f703375 req-39e6cda3-e4cd-45b0-abaf-ea4c6cb1be65 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028958 Aug 19 15:33:23.636912 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 492/974] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 19 15:33:23.778825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-085b828c-5ccb-4d07-8faa-4989d3f0a231 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "POST /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.322960 Aug 19 15:33:23.779465 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 483/975] 10.222.0.75 () {62 vars in 1364 bytes} [Fri Aug 19 15:33:23 2022] POST /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613/os-volume_attachments => generated 188 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 15:33:23.902439 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dfcb37ae-3eb4-4269-9f2b-520cb7611e0b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:23.902928 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dfcb37ae-3eb4-4269-9f2b-520cb7611e0b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:23.909520 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfcb37ae-3eb4-4269-9f2b-520cb7611e0b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:23.909978 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfcb37ae-3eb4-4269-9f2b-520cb7611e0b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:23.910406 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfcb37ae-3eb4-4269-9f2b-520cb7611e0b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:23.911096 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfcb37ae-3eb4-4269-9f2b-520cb7611e0b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:23.911545 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfcb37ae-3eb4-4269-9f2b-520cb7611e0b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:23.911961 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfcb37ae-3eb4-4269-9f2b-520cb7611e0b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:24.006880 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:33:24.140732 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dfcb37ae-3eb4-4269-9f2b-520cb7611e0b tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613/os-volume_attachments/e84446f2-b5cd-4f7e-946c-8d071dde3126" status: 202 len: 0 microversion: 2.20 time: 0.242169 Aug 19 15:33:24.141345 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 493/976] 10.222.0.75 () {60 vars in 1457 bytes} [Fri Aug 19 15:33:23 2022] DELETE /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613/os-volume_attachments/e84446f2-b5cd-4f7e-946c-8d071dde3126 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:33:24.201272 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a55f08e1-644b-4c58-b938-3067d0d658cb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:33:24.201820 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a55f08e1-644b-4c58-b938-3067d0d658cb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:24.203631 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=29 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:33:24.209536 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a55f08e1-644b-4c58-b938-3067d0d658cb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:24.210016 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a55f08e1-644b-4c58-b938-3067d0d658cb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:24.210560 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a55f08e1-644b-4c58-b938-3067d0d658cb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:24.211247 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a55f08e1-644b-4c58-b938-3067d0d658cb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:24.211711 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a55f08e1-644b-4c58-b938-3067d0d658cb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:24.212110 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a55f08e1-644b-4c58-b938-3067d0d658cb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:24.240846 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a55f08e1-644b-4c58-b938-3067d0d658cb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120637) unshelve /opt/stack/nova/nova/compute/api.py:4584}} Aug 19 15:33:24.303885 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a55f08e1-644b-4c58-b938-3067d0d658cb tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "POST /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613/action" status: 202 len: 0 microversion: 2.20 time: 0.106463 Aug 19 15:33:24.305011 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 484/977] 10.222.0.75 () {62 vars in 1319 bytes} [Fri Aug 19 15:33:24 2022] POST /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:33:24.312934 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bdd812b6-ef43-4205-b84e-5eb8f7d1a33a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:24.313535 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bdd812b6-ef43-4205-b84e-5eb8f7d1a33a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:24.320342 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdd812b6-ef43-4205-b84e-5eb8f7d1a33a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:24.320853 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdd812b6-ef43-4205-b84e-5eb8f7d1a33a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:24.321284 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdd812b6-ef43-4205-b84e-5eb8f7d1a33a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:24.321974 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdd812b6-ef43-4205-b84e-5eb8f7d1a33a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:24.322431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdd812b6-ef43-4205-b84e-5eb8f7d1a33a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:24.323009 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdd812b6-ef43-4205-b84e-5eb8f7d1a33a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:24.460573 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bdd812b6-ef43-4205-b84e-5eb8f7d1a33a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:24.468894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bdd812b6-ef43-4205-b84e-5eb8f7d1a33a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:24.470923 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bdd812b6-ef43-4205-b84e-5eb8f7d1a33a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:24.472102 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bdd812b6-ef43-4205-b84e-5eb8f7d1a33a tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1671 microversion: 2.20 time: 0.163116 Aug 19 15:33:24.474127 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 494/978] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:24 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:25.494743 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-292c934d-afb1-4af5-bcc7-18866d5645c4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:25.495375 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-292c934d-afb1-4af5-bcc7-18866d5645c4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:25.501945 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-292c934d-afb1-4af5-bcc7-18866d5645c4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:25.502569 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-292c934d-afb1-4af5-bcc7-18866d5645c4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:25.503017 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-292c934d-afb1-4af5-bcc7-18866d5645c4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:25.503793 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-292c934d-afb1-4af5-bcc7-18866d5645c4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:25.504767 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-292c934d-afb1-4af5-bcc7-18866d5645c4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:25.505190 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-292c934d-afb1-4af5-bcc7-18866d5645c4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:25.639116 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-292c934d-afb1-4af5-bcc7-18866d5645c4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:25.647921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-292c934d-afb1-4af5-bcc7-18866d5645c4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:25.649451 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-292c934d-afb1-4af5-bcc7-18866d5645c4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:25.650610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-292c934d-afb1-4af5-bcc7-18866d5645c4 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1729 microversion: 2.20 time: 0.159862 Aug 19 15:33:25.651168 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 485/979] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:25 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:26.675779 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d822d2a7-a958-4c2b-9b75-89239b17ba83 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:26.677014 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d822d2a7-a958-4c2b-9b75-89239b17ba83 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:26.685237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=33 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:33:26.689855 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d822d2a7-a958-4c2b-9b75-89239b17ba83 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:26.690554 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d822d2a7-a958-4c2b-9b75-89239b17ba83 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:26.690992 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d822d2a7-a958-4c2b-9b75-89239b17ba83 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:26.691911 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d822d2a7-a958-4c2b-9b75-89239b17ba83 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:26.692367 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d822d2a7-a958-4c2b-9b75-89239b17ba83 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:26.692826 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d822d2a7-a958-4c2b-9b75-89239b17ba83 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:26.838653 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d822d2a7-a958-4c2b-9b75-89239b17ba83 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:26.846898 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d822d2a7-a958-4c2b-9b75-89239b17ba83 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:26.848405 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d822d2a7-a958-4c2b-9b75-89239b17ba83 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:26.849570 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d822d2a7-a958-4c2b-9b75-89239b17ba83 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1729 microversion: 2.20 time: 0.179589 Aug 19 15:33:26.850221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 495/980] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:26 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:27.873181 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f5ca17ea-6403-4bf4-8a03-8f91e9e79def tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:27.873866 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f5ca17ea-6403-4bf4-8a03-8f91e9e79def tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:27.880850 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ca17ea-6403-4bf4-8a03-8f91e9e79def tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:27.881342 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ca17ea-6403-4bf4-8a03-8f91e9e79def tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:27.881755 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ca17ea-6403-4bf4-8a03-8f91e9e79def tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:27.882442 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ca17ea-6403-4bf4-8a03-8f91e9e79def tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:27.882882 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ca17ea-6403-4bf4-8a03-8f91e9e79def tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:27.883298 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5ca17ea-6403-4bf4-8a03-8f91e9e79def tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:28.014191 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f5ca17ea-6403-4bf4-8a03-8f91e9e79def tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:28.022959 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f5ca17ea-6403-4bf4-8a03-8f91e9e79def tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:28.024471 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f5ca17ea-6403-4bf4-8a03-8f91e9e79def tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:28.025652 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f5ca17ea-6403-4bf4-8a03-8f91e9e79def tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1729 microversion: 2.20 time: 0.156337 Aug 19 15:33:28.026205 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 486/981] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:27 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:29.047615 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c15d0403-934e-499e-96cf-9c66c2a83497 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:29.048323 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c15d0403-934e-499e-96cf-9c66c2a83497 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:29.055850 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c15d0403-934e-499e-96cf-9c66c2a83497 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:29.056317 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c15d0403-934e-499e-96cf-9c66c2a83497 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:29.056781 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c15d0403-934e-499e-96cf-9c66c2a83497 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:29.057474 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c15d0403-934e-499e-96cf-9c66c2a83497 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:29.057922 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c15d0403-934e-499e-96cf-9c66c2a83497 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:29.058342 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c15d0403-934e-499e-96cf-9c66c2a83497 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:29.290418 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c15d0403-934e-499e-96cf-9c66c2a83497 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:29.306539 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c15d0403-934e-499e-96cf-9c66c2a83497 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:29.308600 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c15d0403-934e-499e-96cf-9c66c2a83497 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:29.309980 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c15d0403-934e-499e-96cf-9c66c2a83497 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1729 microversion: 2.20 time: 0.266244 Aug 19 15:33:29.310713 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 496/982] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:29 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1729 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:30.009195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-70f5f2c9-16dd-4df5-afd7-5aaf60d6e905 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:30.010051 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-70f5f2c9-16dd-4df5-afd7-5aaf60d6e905 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:30.023945 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70f5f2c9-16dd-4df5-afd7-5aaf60d6e905 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:30.025522 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70f5f2c9-16dd-4df5-afd7-5aaf60d6e905 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:30.025522 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70f5f2c9-16dd-4df5-afd7-5aaf60d6e905 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:30.027881 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70f5f2c9-16dd-4df5-afd7-5aaf60d6e905 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:30.029718 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70f5f2c9-16dd-4df5-afd7-5aaf60d6e905 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:30.030885 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70f5f2c9-16dd-4df5-afd7-5aaf60d6e905 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:30.039132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-edd8a752-076b-46bf-ab3e-43a0436629db req-b37829ce-660a-4697-969e-893ed19a947f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "265f2d7d-c0ad-4cc7-bf83-27ea63353ecd", "tag": "a4de4f1a-9970-4238-889e-a094171b341d"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:33:30.051852 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-edd8a752-076b-46bf-ab3e-43a0436629db req-b37829ce-660a-4697-969e-893ed19a947f service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:30.052550 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-edd8a752-076b-46bf-ab3e-43a0436629db req-b37829ce-660a-4697-969e-893ed19a947f service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:30.053112 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-edd8a752-076b-46bf-ab3e-43a0436629db req-b37829ce-660a-4697-969e-893ed19a947f service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:30.068249 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-edd8a752-076b-46bf-ab3e-43a0436629db req-b37829ce-660a-4697-969e-893ed19a947f service nova] Creating event network-changed:a4de4f1a-9970-4238-889e-a094171b341d for instance 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd on hv-cinder-83538 Aug 19 15:33:30.075554 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-edd8a752-076b-46bf-ab3e-43a0436629db req-b37829ce-660a-4697-969e-893ed19a947f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042593 Aug 19 15:33:30.076487 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 497/983] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:33:30.083553 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-70f5f2c9-16dd-4df5-afd7-5aaf60d6e905 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:33:30.220007 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-70f5f2c9-16dd-4df5-afd7-5aaf60d6e905 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "DELETE /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 204 len: 0 microversion: 2.1 time: 0.213839 Aug 19 15:33:30.224951 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 487/984] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:33:30 2022] DELETE /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:33:30.232083 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-70242bda-7a17-4b62-adef-49d97139555b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:30.232897 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-70242bda-7a17-4b62-adef-49d97139555b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:30.240286 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70242bda-7a17-4b62-adef-49d97139555b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:30.240897 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70242bda-7a17-4b62-adef-49d97139555b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:30.241451 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70242bda-7a17-4b62-adef-49d97139555b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:30.242198 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70242bda-7a17-4b62-adef-49d97139555b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:30.242728 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70242bda-7a17-4b62-adef-49d97139555b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:30.243228 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70242bda-7a17-4b62-adef-49d97139555b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:30.335046 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-392a16c5-9c41-4bdf-be72-e640a650db01 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:30.336061 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-392a16c5-9c41-4bdf-be72-e640a650db01 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:30.349485 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-392a16c5-9c41-4bdf-be72-e640a650db01 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:30.350279 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-392a16c5-9c41-4bdf-be72-e640a650db01 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:30.350987 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-392a16c5-9c41-4bdf-be72-e640a650db01 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:30.354523 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-392a16c5-9c41-4bdf-be72-e640a650db01 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:30.355212 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-392a16c5-9c41-4bdf-be72-e640a650db01 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:30.355864 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-392a16c5-9c41-4bdf-be72-e640a650db01 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:30.396694 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-70242bda-7a17-4b62-adef-49d97139555b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:30.406395 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-70242bda-7a17-4b62-adef-49d97139555b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1579 microversion: 2.1 time: 0.178567 Aug 19 15:33:30.418160 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 498/985] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:30 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1579 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:30.605310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-392a16c5-9c41-4bdf-be72-e640a650db01 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:30.614937 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-392a16c5-9c41-4bdf-be72-e640a650db01 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:30.617409 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-392a16c5-9c41-4bdf-be72-e640a650db01 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:30.618610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-392a16c5-9c41-4bdf-be72-e640a650db01 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1729 microversion: 2.20 time: 0.288747 Aug 19 15:33:30.619507 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 488/986] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:30 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1729 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:31.429518 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a4af7249-b1fe-47ee-a08d-ccfaba856516 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:31.430380 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a4af7249-b1fe-47ee-a08d-ccfaba856516 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:31.437175 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4af7249-b1fe-47ee-a08d-ccfaba856516 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:31.437752 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4af7249-b1fe-47ee-a08d-ccfaba856516 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:31.438188 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4af7249-b1fe-47ee-a08d-ccfaba856516 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:31.438922 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4af7249-b1fe-47ee-a08d-ccfaba856516 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:31.439535 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4af7249-b1fe-47ee-a08d-ccfaba856516 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:31.439966 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4af7249-b1fe-47ee-a08d-ccfaba856516 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:31.605248 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a4af7249-b1fe-47ee-a08d-ccfaba856516 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:31.614418 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a4af7249-b1fe-47ee-a08d-ccfaba856516 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1579 microversion: 2.1 time: 0.188746 Aug 19 15:33:31.630091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 499/987] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:31 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1579 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:33:31.645365 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4baa5ec6-785c-4744-992a-71b2cd994322 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:31.646055 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4baa5ec6-785c-4744-992a-71b2cd994322 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:31.653833 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4baa5ec6-785c-4744-992a-71b2cd994322 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:31.654317 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4baa5ec6-785c-4744-992a-71b2cd994322 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:31.654768 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4baa5ec6-785c-4744-992a-71b2cd994322 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:31.655498 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4baa5ec6-785c-4744-992a-71b2cd994322 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:31.655947 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4baa5ec6-785c-4744-992a-71b2cd994322 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:31.656369 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4baa5ec6-785c-4744-992a-71b2cd994322 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:31.818443 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4baa5ec6-785c-4744-992a-71b2cd994322 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:31.826862 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4baa5ec6-785c-4744-992a-71b2cd994322 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:31.828456 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4baa5ec6-785c-4744-992a-71b2cd994322 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:31.830288 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4baa5ec6-785c-4744-992a-71b2cd994322 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1729 microversion: 2.20 time: 0.189798 Aug 19 15:33:31.834916 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 489/988] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:31 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:32.643043 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-24217e29-2105-4dcd-a3a1-297ebf6af6cd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:32.643680 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-24217e29-2105-4dcd-a3a1-297ebf6af6cd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:32.650079 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24217e29-2105-4dcd-a3a1-297ebf6af6cd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:32.650559 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24217e29-2105-4dcd-a3a1-297ebf6af6cd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:32.650990 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24217e29-2105-4dcd-a3a1-297ebf6af6cd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:32.651680 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24217e29-2105-4dcd-a3a1-297ebf6af6cd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:32.652129 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24217e29-2105-4dcd-a3a1-297ebf6af6cd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:32.652591 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24217e29-2105-4dcd-a3a1-297ebf6af6cd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:32.794198 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-24217e29-2105-4dcd-a3a1-297ebf6af6cd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:32.805260 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-24217e29-2105-4dcd-a3a1-297ebf6af6cd tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1579 microversion: 2.1 time: 0.166611 Aug 19 15:33:32.816709 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 500/989] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:32 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1579 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:32.852978 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-752ac1ea-9945-4a67-b48b-aee067056bb6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:32.854005 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-752ac1ea-9945-4a67-b48b-aee067056bb6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:32.861244 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-752ac1ea-9945-4a67-b48b-aee067056bb6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:32.862005 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-752ac1ea-9945-4a67-b48b-aee067056bb6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:32.862485 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-752ac1ea-9945-4a67-b48b-aee067056bb6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:32.863263 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-752ac1ea-9945-4a67-b48b-aee067056bb6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:32.863885 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-752ac1ea-9945-4a67-b48b-aee067056bb6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:32.864304 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-752ac1ea-9945-4a67-b48b-aee067056bb6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:32.998244 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-752ac1ea-9945-4a67-b48b-aee067056bb6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:33.006532 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-752ac1ea-9945-4a67-b48b-aee067056bb6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:33.008031 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-752ac1ea-9945-4a67-b48b-aee067056bb6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:33.009234 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-752ac1ea-9945-4a67-b48b-aee067056bb6 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1729 microversion: 2.20 time: 0.160291 Aug 19 15:33:33.009804 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 490/990] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:32 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:33.827125 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-51e387b8-4f3b-4bfb-82ee-570d1c0cf68b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:33.827753 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-51e387b8-4f3b-4bfb-82ee-570d1c0cf68b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:33.835693 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51e387b8-4f3b-4bfb-82ee-570d1c0cf68b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:33.836186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51e387b8-4f3b-4bfb-82ee-570d1c0cf68b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:33.836649 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51e387b8-4f3b-4bfb-82ee-570d1c0cf68b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:33.837512 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51e387b8-4f3b-4bfb-82ee-570d1c0cf68b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:33.837961 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51e387b8-4f3b-4bfb-82ee-570d1c0cf68b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:33.838486 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51e387b8-4f3b-4bfb-82ee-570d1c0cf68b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:34.004257 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-51e387b8-4f3b-4bfb-82ee-570d1c0cf68b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:34.012107 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-51e387b8-4f3b-4bfb-82ee-570d1c0cf68b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1579 microversion: 2.1 time: 0.188798 Aug 19 15:33:34.012703 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 501/991] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:33 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1579 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:34.031800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-768e292a-b52b-45a9-be83-2f90a16e11c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:34.032410 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-768e292a-b52b-45a9-be83-2f90a16e11c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:34.039190 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-768e292a-b52b-45a9-be83-2f90a16e11c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:34.039658 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-768e292a-b52b-45a9-be83-2f90a16e11c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:34.040080 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-768e292a-b52b-45a9-be83-2f90a16e11c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:34.040779 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-768e292a-b52b-45a9-be83-2f90a16e11c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:34.041221 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-768e292a-b52b-45a9-be83-2f90a16e11c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:34.041638 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-768e292a-b52b-45a9-be83-2f90a16e11c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:34.172003 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-768e292a-b52b-45a9-be83-2f90a16e11c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:34.182747 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-768e292a-b52b-45a9-be83-2f90a16e11c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:34.184242 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-768e292a-b52b-45a9-be83-2f90a16e11c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:34.185449 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-768e292a-b52b-45a9-be83-2f90a16e11c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1729 microversion: 2.20 time: 0.157478 Aug 19 15:33:34.186061 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 491/992] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:34 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:35.037769 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-25d4cb00-ce58-41bd-acf0-e7ce5279052b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:35.038442 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-25d4cb00-ce58-41bd-acf0-e7ce5279052b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:35.045221 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25d4cb00-ce58-41bd-acf0-e7ce5279052b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:35.045706 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25d4cb00-ce58-41bd-acf0-e7ce5279052b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:35.046137 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25d4cb00-ce58-41bd-acf0-e7ce5279052b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:35.046837 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25d4cb00-ce58-41bd-acf0-e7ce5279052b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:35.047293 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25d4cb00-ce58-41bd-acf0-e7ce5279052b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:35.047716 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25d4cb00-ce58-41bd-acf0-e7ce5279052b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:35.184646 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-25d4cb00-ce58-41bd-acf0-e7ce5279052b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:35.193212 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-25d4cb00-ce58-41bd-acf0-e7ce5279052b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1579 microversion: 2.1 time: 0.163307 Aug 19 15:33:35.193772 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 502/993] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:35 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:35.213514 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-66ae0599-04a3-48b3-9500-1eff9f4db6c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:35.214109 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-66ae0599-04a3-48b3-9500-1eff9f4db6c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:35.220642 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66ae0599-04a3-48b3-9500-1eff9f4db6c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:35.221116 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66ae0599-04a3-48b3-9500-1eff9f4db6c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:35.221541 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66ae0599-04a3-48b3-9500-1eff9f4db6c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:35.222322 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66ae0599-04a3-48b3-9500-1eff9f4db6c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:35.222666 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66ae0599-04a3-48b3-9500-1eff9f4db6c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:35.223075 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66ae0599-04a3-48b3-9500-1eff9f4db6c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:35.353352 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-66ae0599-04a3-48b3-9500-1eff9f4db6c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:35.363897 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-66ae0599-04a3-48b3-9500-1eff9f4db6c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:35.366709 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-66ae0599-04a3-48b3-9500-1eff9f4db6c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:35.368093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-66ae0599-04a3-48b3-9500-1eff9f4db6c8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1729 microversion: 2.20 time: 0.158441 Aug 19 15:33:35.368690 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 492/994] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:35 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:36.215537 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-70faf987-860a-41f0-a8bd-c2c17a0e685a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:36.216251 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-70faf987-860a-41f0-a8bd-c2c17a0e685a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:36.224780 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70faf987-860a-41f0-a8bd-c2c17a0e685a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:36.225721 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70faf987-860a-41f0-a8bd-c2c17a0e685a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:36.226404 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70faf987-860a-41f0-a8bd-c2c17a0e685a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:36.227417 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70faf987-860a-41f0-a8bd-c2c17a0e685a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:36.228128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70faf987-860a-41f0-a8bd-c2c17a0e685a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:36.228944 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70faf987-860a-41f0-a8bd-c2c17a0e685a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:36.369908 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-70faf987-860a-41f0-a8bd-c2c17a0e685a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:36.377922 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-70faf987-860a-41f0-a8bd-c2c17a0e685a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1579 microversion: 2.1 time: 0.168177 Aug 19 15:33:36.378486 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 503/995] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:36 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1579 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:36.393122 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36a3e710-6744-44d3-ad38-0af7faffb125 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:36.393724 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36a3e710-6744-44d3-ad38-0af7faffb125 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:36.399502 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36a3e710-6744-44d3-ad38-0af7faffb125 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:36.399978 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36a3e710-6744-44d3-ad38-0af7faffb125 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:36.400409 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36a3e710-6744-44d3-ad38-0af7faffb125 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:36.401169 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36a3e710-6744-44d3-ad38-0af7faffb125 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:36.401613 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36a3e710-6744-44d3-ad38-0af7faffb125 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:36.402026 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36a3e710-6744-44d3-ad38-0af7faffb125 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:36.533758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-36a3e710-6744-44d3-ad38-0af7faffb125 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:36.542137 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-36a3e710-6744-44d3-ad38-0af7faffb125 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:36.543638 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-36a3e710-6744-44d3-ad38-0af7faffb125 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:36.544820 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36a3e710-6744-44d3-ad38-0af7faffb125 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1729 microversion: 2.20 time: 0.156254 Aug 19 15:33:36.545380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 493/996] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:36 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:37.399079 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-594837b3-bd9d-428a-9416-84bc9c7927ff tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:37.399666 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-594837b3-bd9d-428a-9416-84bc9c7927ff tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:37.406174 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-594837b3-bd9d-428a-9416-84bc9c7927ff tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:37.406650 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-594837b3-bd9d-428a-9416-84bc9c7927ff tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:37.407116 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-594837b3-bd9d-428a-9416-84bc9c7927ff tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:37.408562 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-594837b3-bd9d-428a-9416-84bc9c7927ff tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:37.408944 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-594837b3-bd9d-428a-9416-84bc9c7927ff tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:37.409364 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-594837b3-bd9d-428a-9416-84bc9c7927ff tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:37.544512 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-594837b3-bd9d-428a-9416-84bc9c7927ff tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:37.553333 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-594837b3-bd9d-428a-9416-84bc9c7927ff tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1579 microversion: 2.1 time: 0.158093 Aug 19 15:33:37.553923 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 504/997] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:37 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:37.569027 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f427dd43-ddb7-47d0-84a5-42c14adf4eac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:37.569646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f427dd43-ddb7-47d0-84a5-42c14adf4eac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:37.576554 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f427dd43-ddb7-47d0-84a5-42c14adf4eac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:37.577049 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f427dd43-ddb7-47d0-84a5-42c14adf4eac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:37.577485 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f427dd43-ddb7-47d0-84a5-42c14adf4eac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:37.578187 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f427dd43-ddb7-47d0-84a5-42c14adf4eac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:37.578689 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f427dd43-ddb7-47d0-84a5-42c14adf4eac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:37.579260 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f427dd43-ddb7-47d0-84a5-42c14adf4eac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:37.716763 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f427dd43-ddb7-47d0-84a5-42c14adf4eac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:37.725557 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f427dd43-ddb7-47d0-84a5-42c14adf4eac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:37.727063 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f427dd43-ddb7-47d0-84a5-42c14adf4eac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:37.728211 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f427dd43-ddb7-47d0-84a5-42c14adf4eac tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1729 microversion: 2.20 time: 0.163592 Aug 19 15:33:37.728797 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 494/998] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:37 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:38.574755 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9f9e0b1a-410b-4217-8446-fce4ff958891 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:38.575409 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9f9e0b1a-410b-4217-8446-fce4ff958891 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:38.582142 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f9e0b1a-410b-4217-8446-fce4ff958891 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:38.582621 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f9e0b1a-410b-4217-8446-fce4ff958891 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:38.583051 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f9e0b1a-410b-4217-8446-fce4ff958891 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:38.583737 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f9e0b1a-410b-4217-8446-fce4ff958891 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:38.584186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f9e0b1a-410b-4217-8446-fce4ff958891 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:38.584635 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f9e0b1a-410b-4217-8446-fce4ff958891 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:38.715836 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9f9e0b1a-410b-4217-8446-fce4ff958891 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:38.724099 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9f9e0b1a-410b-4217-8446-fce4ff958891 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1579 microversion: 2.1 time: 0.153173 Aug 19 15:33:38.724699 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 505/999] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:38 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:38.750628 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02924fad-41c5-4084-9291-0aac1cfcae41 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:38.751326 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02924fad-41c5-4084-9291-0aac1cfcae41 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:38.757671 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02924fad-41c5-4084-9291-0aac1cfcae41 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:38.758147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02924fad-41c5-4084-9291-0aac1cfcae41 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:38.758577 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02924fad-41c5-4084-9291-0aac1cfcae41 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:38.759259 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02924fad-41c5-4084-9291-0aac1cfcae41 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:38.759707 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02924fad-41c5-4084-9291-0aac1cfcae41 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:38.760152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02924fad-41c5-4084-9291-0aac1cfcae41 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:38.762768 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:33:38.892420 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-02924fad-41c5-4084-9291-0aac1cfcae41 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:38.902003 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-02924fad-41c5-4084-9291-0aac1cfcae41 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:38.903498 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-02924fad-41c5-4084-9291-0aac1cfcae41 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:38.904672 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02924fad-41c5-4084-9291-0aac1cfcae41 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1729 microversion: 2.20 time: 0.157929 Aug 19 15:33:38.905236 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 495/1000] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:38 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:39.745538 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2425837d-09d7-477a-ae82-f722f2a445e2 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:39.746141 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2425837d-09d7-477a-ae82-f722f2a445e2 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:39.753261 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2425837d-09d7-477a-ae82-f722f2a445e2 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:39.753742 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2425837d-09d7-477a-ae82-f722f2a445e2 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:39.754171 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2425837d-09d7-477a-ae82-f722f2a445e2 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:39.754855 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2425837d-09d7-477a-ae82-f722f2a445e2 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:39.755301 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2425837d-09d7-477a-ae82-f722f2a445e2 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:39.755721 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2425837d-09d7-477a-ae82-f722f2a445e2 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:39.891229 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2425837d-09d7-477a-ae82-f722f2a445e2 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:39.899562 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2425837d-09d7-477a-ae82-f722f2a445e2 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1579 microversion: 2.1 time: 0.157881 Aug 19 15:33:39.900123 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 506/1001] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:39 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:39.928278 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0bc925ea-9b3a-4804-84ac-f14fa2aeb8e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:39.928852 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0bc925ea-9b3a-4804-84ac-f14fa2aeb8e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:39.935470 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bc925ea-9b3a-4804-84ac-f14fa2aeb8e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:39.935954 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bc925ea-9b3a-4804-84ac-f14fa2aeb8e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:39.936419 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bc925ea-9b3a-4804-84ac-f14fa2aeb8e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:39.937108 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bc925ea-9b3a-4804-84ac-f14fa2aeb8e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:39.937623 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bc925ea-9b3a-4804-84ac-f14fa2aeb8e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:39.938051 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bc925ea-9b3a-4804-84ac-f14fa2aeb8e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:40.072625 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0bc925ea-9b3a-4804-84ac-f14fa2aeb8e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:40.081419 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0bc925ea-9b3a-4804-84ac-f14fa2aeb8e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:40.082929 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0bc925ea-9b3a-4804-84ac-f14fa2aeb8e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:40.084116 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0bc925ea-9b3a-4804-84ac-f14fa2aeb8e8 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1729 microversion: 2.20 time: 0.159904 Aug 19 15:33:40.084738 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 496/1002] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:39 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:40.921274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a739f46b-8dad-4050-bcd4-fe163421bd9a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:40.921808 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a739f46b-8dad-4050-bcd4-fe163421bd9a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:40.930376 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a739f46b-8dad-4050-bcd4-fe163421bd9a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:40.930936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a739f46b-8dad-4050-bcd4-fe163421bd9a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:40.931727 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a739f46b-8dad-4050-bcd4-fe163421bd9a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:40.933016 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a739f46b-8dad-4050-bcd4-fe163421bd9a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:40.933493 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a739f46b-8dad-4050-bcd4-fe163421bd9a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:40.933926 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a739f46b-8dad-4050-bcd4-fe163421bd9a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:41.072970 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a739f46b-8dad-4050-bcd4-fe163421bd9a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:41.081521 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a739f46b-8dad-4050-bcd4-fe163421bd9a tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 200 len: 1579 microversion: 2.1 time: 0.164159 Aug 19 15:33:41.082098 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 507/1003] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:40 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:41.106417 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2f956655-a6a4-4098-bb6a-fe8f7aeb863e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:41.107156 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2f956655-a6a4-4098-bb6a-fe8f7aeb863e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:41.114553 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f956655-a6a4-4098-bb6a-fe8f7aeb863e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:41.115043 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f956655-a6a4-4098-bb6a-fe8f7aeb863e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:41.115478 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f956655-a6a4-4098-bb6a-fe8f7aeb863e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:41.116168 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f956655-a6a4-4098-bb6a-fe8f7aeb863e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:41.116654 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f956655-a6a4-4098-bb6a-fe8f7aeb863e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:41.117112 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f956655-a6a4-4098-bb6a-fe8f7aeb863e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:41.254355 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2f956655-a6a4-4098-bb6a-fe8f7aeb863e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:41.262785 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2f956655-a6a4-4098-bb6a-fe8f7aeb863e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:41.264537 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2f956655-a6a4-4098-bb6a-fe8f7aeb863e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:41.265775 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2f956655-a6a4-4098-bb6a-fe8f7aeb863e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1729 microversion: 2.20 time: 0.163300 Aug 19 15:33:41.266417 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 497/1004] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:41 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 15:33:41.363571 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-699355b8-b1a0-4fbd-8f8e-10a9396deec2 req-b6baa2da-0b6c-4ba9-bd5e-6d18bb4afea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265f2d7d-c0ad-4cc7-bf83-27ea63353ecd", "name": "network-vif-deleted", "tag": "a4de4f1a-9970-4238-889e-a094171b341d"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:33:41.373252 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-699355b8-b1a0-4fbd-8f8e-10a9396deec2 req-b6baa2da-0b6c-4ba9-bd5e-6d18bb4afea3 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:41.373780 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-699355b8-b1a0-4fbd-8f8e-10a9396deec2 req-b6baa2da-0b6c-4ba9-bd5e-6d18bb4afea3 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:41.374213 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-699355b8-b1a0-4fbd-8f8e-10a9396deec2 req-b6baa2da-0b6c-4ba9-bd5e-6d18bb4afea3 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:41.386528 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-699355b8-b1a0-4fbd-8f8e-10a9396deec2 req-b6baa2da-0b6c-4ba9-bd5e-6d18bb4afea3 service nova] Creating event network-vif-deleted:a4de4f1a-9970-4238-889e-a094171b341d for instance 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd on hv-cinder-83538 Aug 19 15:33:41.391338 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-699355b8-b1a0-4fbd-8f8e-10a9396deec2 req-b6baa2da-0b6c-4ba9-bd5e-6d18bb4afea3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094792 Aug 19 15:33:41.391962 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 508/1005] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:33:42.102182 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6a152818-7365-408a-bff1-dd9e0647b871 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:42.102731 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6a152818-7365-408a-bff1-dd9e0647b871 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:42.108938 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a152818-7365-408a-bff1-dd9e0647b871 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:42.109568 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a152818-7365-408a-bff1-dd9e0647b871 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:42.109836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a152818-7365-408a-bff1-dd9e0647b871 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:42.111133 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a152818-7365-408a-bff1-dd9e0647b871 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:42.111897 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a152818-7365-408a-bff1-dd9e0647b871 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:42.112327 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a152818-7365-408a-bff1-dd9e0647b871 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:42.126653 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-6a152818-7365-408a-bff1-dd9e0647b871 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] HTTP exception thrown: Instance 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd could not be found. Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6a152818-7365-408a-bff1-dd9e0647b871 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Request method failure captured: Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd HTTP/1.1 Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6t2N5QTS_4OCGB0jgRUs0TSZzo2gl9qPhLPBfZUSjIOkLupXAev8tE5hQIOymfGQCL91SiFPi0c0msCN6rExdOuO8GikczGQcNy4o6Ig8ye1xUwkhIWxI8WVn6lBSuaRTlucMzO_v8bDaIgxLgIVpePd86TxVoIBmJeV0XPCb-IPXQ Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: 0add00db6668475093f558e9700333d1 Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-TestVolumeBootPattern-422588122 Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:33:42.128509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:33:42.130261 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0add00db6668475093f558e9700333d1", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0add00db6668475093f558e9700333d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0add00db6668475093f558e9700333d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0add00db6668475093f558e9700333d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:33:42.130261 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-TestVolumeBootPattern-422588122 Aug 19 15:33:42.130261 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 0add00db6668475093f558e9700333d1 Aug 19 15:33:42.130261 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-TestVolumeBootPattern-422588122 Aug 19 15:33:42.130261 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-TestVolumeBootPattern-422588122-project Aug 19 15:33:42.130261 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:33:42.130261 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:33:42.130261 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: af3e7eea0b2840b79404b370382ab44a Aug 19 15:33:42.130261 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-TestVolumeBootPattern-422588122-project Aug 19 15:33:42.130261 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:33:42.130261 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Instance 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd could not be found. Aug 19 15:33:42.130261 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': '265f2d7d-c0ad-4cc7-bf83-27ea63353ecd'} Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd could not be found. Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:33:42.131204 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:33:42.132839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:33:42.132839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:33:42.132839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:33:42.132839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:33:42.132839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:33:42.132839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:33:42.132839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:33:42.132839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd could not be found. Aug 19 15:33:42.132839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:33:42.132839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:33:42.132839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:33:42.132839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:33:42.132839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:33:42.132839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:33:42.132839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:33:42.132839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:33:42.132839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd could not be found. Aug 19 15:33:42.132839 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:33:42.134257 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6a152818-7365-408a-bff1-dd9e0647b871 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Returning 404 to user: Instance 265f2d7d-c0ad-4cc7-bf83-27ea63353ecd could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:33:42.134257 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6a152818-7365-408a-bff1-dd9e0647b871 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd" status: 404 len: 111 microversion: 2.1 time: 0.031743 Aug 19 15:33:42.134257 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 498/1006] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:42 2022] GET /compute/v2.1/servers/265f2d7d-c0ad-4cc7-bf83-27ea63353ecd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:33:42.288817 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b2e1da2d-fd63-4592-a5c3-04b0334f9f7c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:42.289501 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b2e1da2d-fd63-4592-a5c3-04b0334f9f7c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:42.295542 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2e1da2d-fd63-4592-a5c3-04b0334f9f7c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:42.296019 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2e1da2d-fd63-4592-a5c3-04b0334f9f7c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:42.296473 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2e1da2d-fd63-4592-a5c3-04b0334f9f7c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:42.297157 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2e1da2d-fd63-4592-a5c3-04b0334f9f7c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:42.297604 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2e1da2d-fd63-4592-a5c3-04b0334f9f7c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:42.298031 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2e1da2d-fd63-4592-a5c3-04b0334f9f7c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:42.434557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b2e1da2d-fd63-4592-a5c3-04b0334f9f7c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:42.443430 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b2e1da2d-fd63-4592-a5c3-04b0334f9f7c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:42.444950 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b2e1da2d-fd63-4592-a5c3-04b0334f9f7c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:42.446090 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b2e1da2d-fd63-4592-a5c3-04b0334f9f7c tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1729 microversion: 2.20 time: 0.162079 Aug 19 15:33:42.446652 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 509/1007] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:42 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:43.469246 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-80acd699-196a-4528-a4e5-bc2230a70b90 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:43.469946 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-80acd699-196a-4528-a4e5-bc2230a70b90 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:43.476336 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80acd699-196a-4528-a4e5-bc2230a70b90 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:43.476846 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80acd699-196a-4528-a4e5-bc2230a70b90 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:43.477277 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80acd699-196a-4528-a4e5-bc2230a70b90 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:43.477960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80acd699-196a-4528-a4e5-bc2230a70b90 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:43.478412 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80acd699-196a-4528-a4e5-bc2230a70b90 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:43.478833 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80acd699-196a-4528-a4e5-bc2230a70b90 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:43.622154 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-80acd699-196a-4528-a4e5-bc2230a70b90 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:43.632411 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-80acd699-196a-4528-a4e5-bc2230a70b90 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:43.633931 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-80acd699-196a-4528-a4e5-bc2230a70b90 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:43.635173 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-80acd699-196a-4528-a4e5-bc2230a70b90 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1729 microversion: 2.20 time: 0.169861 Aug 19 15:33:43.635734 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 499/1008] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:43 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:43.845812 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-7af2482f-1b4e-4ed2-94d9-965f04548c28 req-fc411bf4-0d05-4d4c-beda-759e6a5baae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f43980-62ff-449e-bcbf-6aef66451613", "name": "network-vif-plugged", "status": "completed", "tag": "1123119a-1372-416f-b5f1-586c7ed3bbd7"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:33:43.856413 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-7af2482f-1b4e-4ed2-94d9-965f04548c28 req-fc411bf4-0d05-4d4c-beda-759e6a5baae2 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:43.856910 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-7af2482f-1b4e-4ed2-94d9-965f04548c28 req-fc411bf4-0d05-4d4c-beda-759e6a5baae2 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:43.857579 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-7af2482f-1b4e-4ed2-94d9-965f04548c28 req-fc411bf4-0d05-4d4c-beda-759e6a5baae2 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:43.869120 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-7af2482f-1b4e-4ed2-94d9-965f04548c28 req-fc411bf4-0d05-4d4c-beda-759e6a5baae2 service nova] Creating event network-vif-plugged:1123119a-1372-416f-b5f1-586c7ed3bbd7 for instance a3f43980-62ff-449e-bcbf-6aef66451613 on hv-cinder-83538 Aug 19 15:33:43.874008 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-7af2482f-1b4e-4ed2-94d9-965f04548c28 req-fc411bf4-0d05-4d4c-beda-759e6a5baae2 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032422 Aug 19 15:33:43.874606 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 510/1009] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:33:44.659459 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8ba08fe1-c328-4189-a39a-b65f8e9ff71e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:44.660087 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8ba08fe1-c328-4189-a39a-b65f8e9ff71e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:44.666507 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ba08fe1-c328-4189-a39a-b65f8e9ff71e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:44.666982 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ba08fe1-c328-4189-a39a-b65f8e9ff71e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:44.671856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ba08fe1-c328-4189-a39a-b65f8e9ff71e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:44.671856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ba08fe1-c328-4189-a39a-b65f8e9ff71e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:44.671856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ba08fe1-c328-4189-a39a-b65f8e9ff71e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:44.671856 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ba08fe1-c328-4189-a39a-b65f8e9ff71e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:44.907422 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8ba08fe1-c328-4189-a39a-b65f8e9ff71e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:44.916249 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8ba08fe1-c328-4189-a39a-b65f8e9ff71e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:44.917877 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8ba08fe1-c328-4189-a39a-b65f8e9ff71e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:44.919163 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8ba08fe1-c328-4189-a39a-b65f8e9ff71e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1729 microversion: 2.20 time: 0.264131 Aug 19 15:33:44.919802 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 500/1010] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:44 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1729 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:45.204277 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e58ec221-4124-4ab8-b5c8-59269e847d29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:33:45.204977 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e58ec221-4124-4ab8-b5c8-59269e847d29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:45.211037 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e58ec221-4124-4ab8-b5c8-59269e847d29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:45.211516 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e58ec221-4124-4ab8-b5c8-59269e847d29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:45.211946 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e58ec221-4124-4ab8-b5c8-59269e847d29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:45.212658 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e58ec221-4124-4ab8-b5c8-59269e847d29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:45.213106 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e58ec221-4124-4ab8-b5c8-59269e847d29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:45.213523 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e58ec221-4124-4ab8-b5c8-59269e847d29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:45.217340 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SELECT=95 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:33:45.240830 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-e58ec221-4124-4ab8-b5c8-59269e847d29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lazy-loading 'flavor' on Instance uuid 446054b4-8b4f-45ec-9e9b-4a552af02065 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:33:45.270900 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5d70c1f8-2ca7-4fdb-b5ee-ef167858cc4b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:45.271635 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d70c1f8-2ca7-4fdb-b5ee-ef167858cc4b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:45.278509 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d70c1f8-2ca7-4fdb-b5ee-ef167858cc4b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:45.279300 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d70c1f8-2ca7-4fdb-b5ee-ef167858cc4b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:45.280114 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d70c1f8-2ca7-4fdb-b5ee-ef167858cc4b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:45.281547 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d70c1f8-2ca7-4fdb-b5ee-ef167858cc4b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:45.282271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d70c1f8-2ca7-4fdb-b5ee-ef167858cc4b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:45.282731 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d70c1f8-2ca7-4fdb-b5ee-ef167858cc4b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:45.319263 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d70c1f8-2ca7-4fdb-b5ee-ef167858cc4b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:33:45.341386 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e58ec221-4124-4ab8-b5c8-59269e847d29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "POST /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065/action" status: 202 len: 0 microversion: 2.1 time: 0.142109 Aug 19 15:33:45.342456 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 511/1011] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Aug 19 15:33:45 2022] POST /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:33:45.348493 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-6f896506-9652-40da-b778-f4a5270d3b7e req-5ac83096-0d81-4dde-82e9-f05f36781110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a1ec3f-5819-42b2-8e3d-5d6327ba52f8", "tag": "cdfe8c13-bb9b-4403-9e35-60ecb60215b9"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:33:45.358028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6f896506-9652-40da-b778-f4a5270d3b7e req-5ac83096-0d81-4dde-82e9-f05f36781110 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:45.358676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6f896506-9652-40da-b778-f4a5270d3b7e req-5ac83096-0d81-4dde-82e9-f05f36781110 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:45.359384 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6f896506-9652-40da-b778-f4a5270d3b7e req-5ac83096-0d81-4dde-82e9-f05f36781110 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:45.373652 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-6f896506-9652-40da-b778-f4a5270d3b7e req-5ac83096-0d81-4dde-82e9-f05f36781110 service nova] Creating event network-changed:cdfe8c13-bb9b-4403-9e35-60ecb60215b9 for instance 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 on hv-cinder-83538 Aug 19 15:33:45.379622 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-6f896506-9652-40da-b778-f4a5270d3b7e req-5ac83096-0d81-4dde-82e9-f05f36781110 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035696 Aug 19 15:33:45.380615 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 512/1012] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:33:45.386451 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d72bfb5e-fe7c-4490-8862-e422ab0ebb24 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:45.387237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d72bfb5e-fe7c-4490-8862-e422ab0ebb24 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:45.393713 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d72bfb5e-fe7c-4490-8862-e422ab0ebb24 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:45.394118 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d72bfb5e-fe7c-4490-8862-e422ab0ebb24 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:45.394672 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d72bfb5e-fe7c-4490-8862-e422ab0ebb24 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:45.395443 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d72bfb5e-fe7c-4490-8862-e422ab0ebb24 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:45.396470 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d72bfb5e-fe7c-4490-8862-e422ab0ebb24 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:45.396470 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d72bfb5e-fe7c-4490-8862-e422ab0ebb24 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:45.405333 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5d70c1f8-2ca7-4fdb-b5ee-ef167858cc4b tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "DELETE /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 204 len: 0 microversion: 2.1 time: 0.139015 Aug 19 15:33:45.409963 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 501/1013] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:33:45 2022] DELETE /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 19 15:33:45.415452 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5f746d1e-de7e-4942-b3cb-be4a114e190f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:45.416821 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5f746d1e-de7e-4942-b3cb-be4a114e190f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:45.422367 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f746d1e-de7e-4942-b3cb-be4a114e190f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:45.423040 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f746d1e-de7e-4942-b3cb-be4a114e190f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:45.423604 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f746d1e-de7e-4942-b3cb-be4a114e190f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:45.424377 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f746d1e-de7e-4942-b3cb-be4a114e190f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:45.424928 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f746d1e-de7e-4942-b3cb-be4a114e190f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:45.425424 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f746d1e-de7e-4942-b3cb-be4a114e190f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:45.613194 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d72bfb5e-fe7c-4490-8862-e422ab0ebb24 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:45.617317 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5f746d1e-de7e-4942-b3cb-be4a114e190f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:45.622108 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d72bfb5e-fe7c-4490-8862-e422ab0ebb24 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1567 microversion: 2.1 time: 0.240156 Aug 19 15:33:45.622716 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 513/1014] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:45 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:45.626958 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5f746d1e-de7e-4942-b3cb-be4a114e190f tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1578 microversion: 2.1 time: 0.215564 Aug 19 15:33:45.627701 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 502/1015] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:45 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1578 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:33:45.943893 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e13905a0-89dd-4c74-ba65-89c9ed7c89ab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:45.944540 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e13905a0-89dd-4c74-ba65-89c9ed7c89ab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:45.951106 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e13905a0-89dd-4c74-ba65-89c9ed7c89ab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:45.952636 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e13905a0-89dd-4c74-ba65-89c9ed7c89ab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:45.953199 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e13905a0-89dd-4c74-ba65-89c9ed7c89ab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:45.954786 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e13905a0-89dd-4c74-ba65-89c9ed7c89ab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:45.955643 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e13905a0-89dd-4c74-ba65-89c9ed7c89ab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:45.956345 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e13905a0-89dd-4c74-ba65-89c9ed7c89ab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:46.357298 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e13905a0-89dd-4c74-ba65-89c9ed7c89ab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:46.370054 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e13905a0-89dd-4c74-ba65-89c9ed7c89ab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:46.371778 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e13905a0-89dd-4c74-ba65-89c9ed7c89ab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:46.373187 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e13905a0-89dd-4c74-ba65-89c9ed7c89ab tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1729 microversion: 2.20 time: 0.433143 Aug 19 15:33:46.373956 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 514/1016] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:45 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1729 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:46.643797 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5086e0eb-5d2b-4b0f-a275-b4642f258509 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:46.644800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5086e0eb-5d2b-4b0f-a275-b4642f258509 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:46.647225 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d70bd6f9-7eaf-4464-8f83-7bc7f7083d0d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:46.647825 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d70bd6f9-7eaf-4464-8f83-7bc7f7083d0d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:46.651139 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5086e0eb-5d2b-4b0f-a275-b4642f258509 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:46.651625 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5086e0eb-5d2b-4b0f-a275-b4642f258509 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:46.652059 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5086e0eb-5d2b-4b0f-a275-b4642f258509 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:46.652774 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5086e0eb-5d2b-4b0f-a275-b4642f258509 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:46.653224 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5086e0eb-5d2b-4b0f-a275-b4642f258509 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:46.653644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5086e0eb-5d2b-4b0f-a275-b4642f258509 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:46.654061 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d70bd6f9-7eaf-4464-8f83-7bc7f7083d0d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:46.654541 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d70bd6f9-7eaf-4464-8f83-7bc7f7083d0d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:46.654968 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d70bd6f9-7eaf-4464-8f83-7bc7f7083d0d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:46.655647 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d70bd6f9-7eaf-4464-8f83-7bc7f7083d0d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:46.656098 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d70bd6f9-7eaf-4464-8f83-7bc7f7083d0d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:46.656543 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d70bd6f9-7eaf-4464-8f83-7bc7f7083d0d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:46.852488 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5086e0eb-5d2b-4b0f-a275-b4642f258509 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:46.856971 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d70bd6f9-7eaf-4464-8f83-7bc7f7083d0d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:46.860628 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5086e0eb-5d2b-4b0f-a275-b4642f258509 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1567 microversion: 2.1 time: 0.221053 Aug 19 15:33:46.861215 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 503/1017] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:46 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:46.865272 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d70bd6f9-7eaf-4464-8f83-7bc7f7083d0d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1578 microversion: 2.1 time: 0.221838 Aug 19 15:33:46.865838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 515/1018] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:46 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1578 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:33:47.395603 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-23fe3325-d5b8-44f8-9eec-63fa62dce117 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:47.396213 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-23fe3325-d5b8-44f8-9eec-63fa62dce117 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:47.402214 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23fe3325-d5b8-44f8-9eec-63fa62dce117 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:47.402697 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23fe3325-d5b8-44f8-9eec-63fa62dce117 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:47.403131 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23fe3325-d5b8-44f8-9eec-63fa62dce117 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:47.403820 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23fe3325-d5b8-44f8-9eec-63fa62dce117 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:47.404270 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23fe3325-d5b8-44f8-9eec-63fa62dce117 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:47.404722 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23fe3325-d5b8-44f8-9eec-63fa62dce117 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:47.537430 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-23fe3325-d5b8-44f8-9eec-63fa62dce117 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:47.545818 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-23fe3325-d5b8-44f8-9eec-63fa62dce117 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:47.547469 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-23fe3325-d5b8-44f8-9eec-63fa62dce117 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:47.549383 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-23fe3325-d5b8-44f8-9eec-63fa62dce117 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1716 microversion: 2.20 time: 0.157724 Aug 19 15:33:47.550031 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 504/1019] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:33:47 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:33:47.882878 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9774ec05-e7e0-47df-b080-036be87cb71f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:47.883493 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9774ec05-e7e0-47df-b080-036be87cb71f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:47.887184 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-053670fd-a38e-4a7c-8adb-2e35cada81d5 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:47.888418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-053670fd-a38e-4a7c-8adb-2e35cada81d5 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:47.890260 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9774ec05-e7e0-47df-b080-036be87cb71f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:47.890819 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9774ec05-e7e0-47df-b080-036be87cb71f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:47.892002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9774ec05-e7e0-47df-b080-036be87cb71f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:47.893250 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9774ec05-e7e0-47df-b080-036be87cb71f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:47.894591 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9774ec05-e7e0-47df-b080-036be87cb71f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:47.895118 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9774ec05-e7e0-47df-b080-036be87cb71f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:47.895248 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-053670fd-a38e-4a7c-8adb-2e35cada81d5 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:47.895703 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-053670fd-a38e-4a7c-8adb-2e35cada81d5 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:47.896340 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-053670fd-a38e-4a7c-8adb-2e35cada81d5 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:47.897228 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-053670fd-a38e-4a7c-8adb-2e35cada81d5 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:47.897689 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-053670fd-a38e-4a7c-8adb-2e35cada81d5 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:47.898116 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-053670fd-a38e-4a7c-8adb-2e35cada81d5 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:47.974188 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-053670fd-a38e-4a7c-8adb-2e35cada81d5 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3e7eea0b2840b79404b370382ab44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0add00db6668475093f558e9700333d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:47.989623 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-053670fd-a38e-4a7c-8adb-2e35cada81d5 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 200 len: 1392 microversion: 2.1 time: 0.106771 Aug 19 15:33:47.990271 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 505/1020] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:47 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 1392 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:33:47.994957 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-c5f5eb29-ba21-4227-8f7d-d79a5012b5de req-d101d180-59a7-46de-8881-b45ac462d3ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a1ec3f-5819-42b2-8e3d-5d6327ba52f8", "name": "network-vif-deleted", "tag": "cdfe8c13-bb9b-4403-9e35-60ecb60215b9"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:33:48.008995 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c5f5eb29-ba21-4227-8f7d-d79a5012b5de req-d101d180-59a7-46de-8881-b45ac462d3ac service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:48.009568 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c5f5eb29-ba21-4227-8f7d-d79a5012b5de req-d101d180-59a7-46de-8881-b45ac462d3ac service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:48.010018 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c5f5eb29-ba21-4227-8f7d-d79a5012b5de req-d101d180-59a7-46de-8881-b45ac462d3ac service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:48.022304 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-c5f5eb29-ba21-4227-8f7d-d79a5012b5de req-d101d180-59a7-46de-8881-b45ac462d3ac service nova] Creating event network-vif-deleted:cdfe8c13-bb9b-4403-9e35-60ecb60215b9 for instance 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 on hv-cinder-83538 Aug 19 15:33:48.027217 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-c5f5eb29-ba21-4227-8f7d-d79a5012b5de req-d101d180-59a7-46de-8881-b45ac462d3ac service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035829 Aug 19 15:33:48.028168 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 506/1021] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:33:48.085048 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9774ec05-e7e0-47df-b080-036be87cb71f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:48.093025 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9774ec05-e7e0-47df-b080-036be87cb71f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1567 microversion: 2.1 time: 0.214076 Aug 19 15:33:48.093619 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 516/1022] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:47 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:49.013294 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b65e11f2-e1df-44c5-888f-93e52042ab4d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:49.013989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b65e11f2-e1df-44c5-888f-93e52042ab4d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:49.020837 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b65e11f2-e1df-44c5-888f-93e52042ab4d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:49.021322 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b65e11f2-e1df-44c5-888f-93e52042ab4d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:49.021830 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b65e11f2-e1df-44c5-888f-93e52042ab4d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:49.022597 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b65e11f2-e1df-44c5-888f-93e52042ab4d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:49.023047 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b65e11f2-e1df-44c5-888f-93e52042ab4d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:49.023470 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b65e11f2-e1df-44c5-888f-93e52042ab4d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:49.036964 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-b65e11f2-e1df-44c5-888f-93e52042ab4d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] HTTP exception thrown: Instance 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 could not be found. Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b65e11f2-e1df-44c5-888f-93e52042ab4d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Request method failure captured: Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 HTTP/1.1 Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6t2N5QTS_4OCGB0jgRUs0TSZzo2gl9qPhLPBfZUSjIOkLupXAev8tE5hQIOymfGQCL91SiFPi0c0msCN6rExdOuO8GikczGQcNy4o6Ig8ye1xUwkhIWxI8WVn6lBSuaRTlucMzO_v8bDaIgxLgIVpePd86TxVoIBmJeV0XPCb-IPXQ Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: 0add00db6668475093f558e9700333d1 Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-TestVolumeBootPattern-422588122 Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:33:49.038579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:33:49.040195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0add00db6668475093f558e9700333d1", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0add00db6668475093f558e9700333d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0add00db6668475093f558e9700333d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0add00db6668475093f558e9700333d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:33:49.040195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-TestVolumeBootPattern-422588122 Aug 19 15:33:49.040195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 0add00db6668475093f558e9700333d1 Aug 19 15:33:49.040195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-TestVolumeBootPattern-422588122 Aug 19 15:33:49.040195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-TestVolumeBootPattern-422588122-project Aug 19 15:33:49.040195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:33:49.040195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:33:49.040195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: af3e7eea0b2840b79404b370382ab44a Aug 19 15:33:49.040195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-TestVolumeBootPattern-422588122-project Aug 19 15:33:49.040195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:33:49.040195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Instance 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 could not be found. Aug 19 15:33:49.040195 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': '69a1ec3f-5819-42b2-8e3d-5d6327ba52f8'} Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 could not be found. Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:33:49.041159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:33:49.042418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:33:49.042418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:33:49.042418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:33:49.042418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:33:49.042418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:33:49.042418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:33:49.042418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:33:49.042418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 could not be found. Aug 19 15:33:49.042418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:33:49.042418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:33:49.042418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:33:49.042418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:33:49.042418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:33:49.042418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:33:49.042418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:33:49.042418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:33:49.042418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 could not be found. Aug 19 15:33:49.042418 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:33:49.043637 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b65e11f2-e1df-44c5-888f-93e52042ab4d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Returning 404 to user: Instance 69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:33:49.043637 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b65e11f2-e1df-44c5-888f-93e52042ab4d tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8" status: 404 len: 111 microversion: 2.1 time: 0.031657 Aug 19 15:33:49.043637 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 507/1023] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:49 2022] GET /compute/v2.1/servers/69a1ec3f-5819-42b2-8e3d-5d6327ba52f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:33:49.113859 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4c49bc56-89fc-423d-88d8-b720806b04a5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:49.114486 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4c49bc56-89fc-423d-88d8-b720806b04a5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:49.121053 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c49bc56-89fc-423d-88d8-b720806b04a5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:49.121530 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c49bc56-89fc-423d-88d8-b720806b04a5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:49.121970 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c49bc56-89fc-423d-88d8-b720806b04a5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:49.122669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c49bc56-89fc-423d-88d8-b720806b04a5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:49.123126 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c49bc56-89fc-423d-88d8-b720806b04a5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:49.123553 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c49bc56-89fc-423d-88d8-b720806b04a5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:49.339065 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4c49bc56-89fc-423d-88d8-b720806b04a5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:49.347429 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4c49bc56-89fc-423d-88d8-b720806b04a5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1567 microversion: 2.1 time: 0.238121 Aug 19 15:33:49.348220 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 517/1024] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:49 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:49.566711 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8bf3470b-9fa7-4a1c-992d-9018f810a8e0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:49.567207 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8bf3470b-9fa7-4a1c-992d-9018f810a8e0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:49.573118 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bf3470b-9fa7-4a1c-992d-9018f810a8e0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:49.573599 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bf3470b-9fa7-4a1c-992d-9018f810a8e0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:49.574035 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bf3470b-9fa7-4a1c-992d-9018f810a8e0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:49.574752 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bf3470b-9fa7-4a1c-992d-9018f810a8e0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:49.575207 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bf3470b-9fa7-4a1c-992d-9018f810a8e0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:49.575628 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bf3470b-9fa7-4a1c-992d-9018f810a8e0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:49.588776 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-8bf3470b-9fa7-4a1c-992d-9018f810a8e0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] HTTP exception thrown: Instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 could not be found. Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8bf3470b-9fa7-4a1c-992d-9018f810a8e0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Request method failure captured: Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 HTTP/1.1 Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6t2N5QTS_4OCGB0jgRUs0TSZzo2gl9qPhLPBfZUSjIOkLupXAev8tE5hQIOymfGQCL91SiFPi0c0msCN6rExdOuO8GikczGQcNy4o6Ig8ye1xUwkhIWxI8WVn6lBSuaRTlucMzO_v8bDaIgxLgIVpePd86TxVoIBmJeV0XPCb-IPXQ Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: 0add00db6668475093f558e9700333d1 Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-TestVolumeBootPattern-422588122 Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:33:49.590310 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:33:49.592020 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0add00db6668475093f558e9700333d1", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0add00db6668475093f558e9700333d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0add00db6668475093f558e9700333d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0add00db6668475093f558e9700333d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:33:49.592020 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-TestVolumeBootPattern-422588122 Aug 19 15:33:49.592020 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 0add00db6668475093f558e9700333d1 Aug 19 15:33:49.592020 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-TestVolumeBootPattern-422588122 Aug 19 15:33:49.592020 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-TestVolumeBootPattern-422588122-project Aug 19 15:33:49.592020 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:33:49.592020 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:33:49.592020 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: af3e7eea0b2840b79404b370382ab44a Aug 19 15:33:49.592020 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-TestVolumeBootPattern-422588122-project Aug 19 15:33:49.592020 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:33:49.592020 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 could not be found. Aug 19 15:33:49.592020 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': 'cfb210f1-d4a9-4f36-8880-0d17b7e81557'} Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 could not be found. Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:33:49.593071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 could not be found. Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 could not be found. Aug 19 15:33:49.594646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:33:49.596363 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8bf3470b-9fa7-4a1c-992d-9018f810a8e0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Returning 404 to user: Instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:33:49.596363 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8bf3470b-9fa7-4a1c-992d-9018f810a8e0 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "DELETE /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 404 len: 111 microversion: 2.1 time: 0.029629 Aug 19 15:33:49.596363 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 508/1025] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:33:49 2022] DELETE /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:33:49.600629 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e0ad350f-7d95-4471-a2f9-ea553660b5c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:49.601237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e0ad350f-7d95-4471-a2f9-ea553660b5c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] [instance: cfb210f1-d4a9-4f36-8880-0d17b7e81557] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:49.607180 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0ad350f-7d95-4471-a2f9-ea553660b5c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:49.607659 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0ad350f-7d95-4471-a2f9-ea553660b5c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:49.608092 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0ad350f-7d95-4471-a2f9-ea553660b5c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:49.608817 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0ad350f-7d95-4471-a2f9-ea553660b5c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:49.609271 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0ad350f-7d95-4471-a2f9-ea553660b5c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:49.609697 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0ad350f-7d95-4471-a2f9-ea553660b5c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:49.623101 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-e0ad350f-7d95-4471-a2f9-ea553660b5c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] HTTP exception thrown: Instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 could not be found. Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e0ad350f-7d95-4471-a2f9-ea553660b5c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Request method failure captured: Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 HTTP/1.1 Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6t2N5QTS_4OCGB0jgRUs0TSZzo2gl9qPhLPBfZUSjIOkLupXAev8tE5hQIOymfGQCL91SiFPi0c0msCN6rExdOuO8GikczGQcNy4o6Ig8ye1xUwkhIWxI8WVn6lBSuaRTlucMzO_v8bDaIgxLgIVpePd86TxVoIBmJeV0XPCb-IPXQ Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: 0add00db6668475093f558e9700333d1 Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-TestVolumeBootPattern-422588122 Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:33:49.624743 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:33:49.627002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0add00db6668475093f558e9700333d1", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0add00db6668475093f558e9700333d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0add00db6668475093f558e9700333d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0add00db6668475093f558e9700333d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:33:49.627002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-TestVolumeBootPattern-422588122 Aug 19 15:33:49.627002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 0add00db6668475093f558e9700333d1 Aug 19 15:33:49.627002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-TestVolumeBootPattern-422588122 Aug 19 15:33:49.627002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-TestVolumeBootPattern-422588122-project Aug 19 15:33:49.627002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:33:49.627002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:33:49.627002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: af3e7eea0b2840b79404b370382ab44a Aug 19 15:33:49.627002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-TestVolumeBootPattern-422588122-project Aug 19 15:33:49.627002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:33:49.627002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 could not be found. Aug 19 15:33:49.627002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': 'cfb210f1-d4a9-4f36-8880-0d17b7e81557'} Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 could not be found. Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:33:49.627833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:33:49.629132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:33:49.629132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:33:49.629132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:33:49.629132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:33:49.629132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:33:49.629132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:33:49.629132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:33:49.629132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 could not be found. Aug 19 15:33:49.629132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:33:49.629132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:33:49.629132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:33:49.629132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:33:49.629132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:33:49.629132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:33:49.629132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:33:49.629132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:33:49.629132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 could not be found. Aug 19 15:33:49.629132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:33:49.630286 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e0ad350f-7d95-4471-a2f9-ea553660b5c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Returning 404 to user: Instance cfb210f1-d4a9-4f36-8880-0d17b7e81557 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:33:49.630286 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e0ad350f-7d95-4471-a2f9-ea553660b5c1 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557" status: 404 len: 111 microversion: 2.1 time: 0.029318 Aug 19 15:33:49.630286 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 518/1026] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:49 2022] GET /compute/v2.1/servers/cfb210f1-d4a9-4f36-8880-0d17b7e81557 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:33:50.368151 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9f0730f1-1ae4-4b77-8e7d-be080ab86c2f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:50.368780 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9f0730f1-1ae4-4b77-8e7d-be080ab86c2f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:50.375132 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f0730f1-1ae4-4b77-8e7d-be080ab86c2f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:50.375644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f0730f1-1ae4-4b77-8e7d-be080ab86c2f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:50.376153 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f0730f1-1ae4-4b77-8e7d-be080ab86c2f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:50.376944 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f0730f1-1ae4-4b77-8e7d-be080ab86c2f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:50.377396 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f0730f1-1ae4-4b77-8e7d-be080ab86c2f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:50.377816 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f0730f1-1ae4-4b77-8e7d-be080ab86c2f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:50.513711 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f0730f1-1ae4-4b77-8e7d-be080ab86c2f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:50.522149 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9f0730f1-1ae4-4b77-8e7d-be080ab86c2f tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1567 microversion: 2.1 time: 0.157877 Aug 19 15:33:50.522712 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 509/1027] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:50 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:50.920271 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e22d9d92-99aa-4b51-9e0a-c73ae03814a6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] Calling method '.version_select at 0x7fb53327dca0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:50.943510 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e22d9d92-99aa-4b51-9e0a-c73ae03814a6 tempest-TestVolumeBootPattern-422588122 tempest-TestVolumeBootPattern-422588122-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1301407205" status: 202 len: 0 microversion: 2.1 time: 0.026851 Aug 19 15:33:50.943994 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 519/1028] 10.222.0.75 () {58 vars in 1263 bytes} [Fri Aug 19 15:33:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1301407205 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:33:51.543165 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0acd1453-67b0-4c12-b57b-6e6d6a53a5e7 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:51.543763 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0acd1453-67b0-4c12-b57b-6e6d6a53a5e7 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:51.550870 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0acd1453-67b0-4c12-b57b-6e6d6a53a5e7 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:51.551346 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0acd1453-67b0-4c12-b57b-6e6d6a53a5e7 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:51.551770 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0acd1453-67b0-4c12-b57b-6e6d6a53a5e7 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:51.552477 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0acd1453-67b0-4c12-b57b-6e6d6a53a5e7 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:51.552921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0acd1453-67b0-4c12-b57b-6e6d6a53a5e7 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:51.553335 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0acd1453-67b0-4c12-b57b-6e6d6a53a5e7 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:51.691498 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0acd1453-67b0-4c12-b57b-6e6d6a53a5e7 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:51.699642 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0acd1453-67b0-4c12-b57b-6e6d6a53a5e7 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1567 microversion: 2.1 time: 0.160282 Aug 19 15:33:51.700227 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 510/1029] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:51 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:52.722892 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-40f1829d-d7cd-400b-9cf6-5398859a8fbb tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:52.723495 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-40f1829d-d7cd-400b-9cf6-5398859a8fbb tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:52.730922 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40f1829d-d7cd-400b-9cf6-5398859a8fbb tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:52.731401 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40f1829d-d7cd-400b-9cf6-5398859a8fbb tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:52.731831 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40f1829d-d7cd-400b-9cf6-5398859a8fbb tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:52.732553 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40f1829d-d7cd-400b-9cf6-5398859a8fbb tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:52.732999 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40f1829d-d7cd-400b-9cf6-5398859a8fbb tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:52.734084 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40f1829d-d7cd-400b-9cf6-5398859a8fbb tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:52.879117 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-40f1829d-d7cd-400b-9cf6-5398859a8fbb tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:52.887470 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-40f1829d-d7cd-400b-9cf6-5398859a8fbb tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1567 microversion: 2.1 time: 0.169683 Aug 19 15:33:52.888233 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 520/1030] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:52 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:33:53.912416 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-186011a4-15f6-47c4-ae4e-fc0a5df36ab9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:53.913041 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-186011a4-15f6-47c4-ae4e-fc0a5df36ab9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:53.919380 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-186011a4-15f6-47c4-ae4e-fc0a5df36ab9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:53.919854 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-186011a4-15f6-47c4-ae4e-fc0a5df36ab9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:53.920277 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-186011a4-15f6-47c4-ae4e-fc0a5df36ab9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:53.928103 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-186011a4-15f6-47c4-ae4e-fc0a5df36ab9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:53.930484 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-186011a4-15f6-47c4-ae4e-fc0a5df36ab9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:53.931093 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-186011a4-15f6-47c4-ae4e-fc0a5df36ab9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:54.134525 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-186011a4-15f6-47c4-ae4e-fc0a5df36ab9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:54.145979 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-186011a4-15f6-47c4-ae4e-fc0a5df36ab9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1567 microversion: 2.1 time: 0.239796 Aug 19 15:33:54.147053 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 511/1031] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:53 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:55.167489 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f5edcae3-6f0c-45c7-ae98-8176006ea7b3 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:55.168167 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f5edcae3-6f0c-45c7-ae98-8176006ea7b3 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:55.176740 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5edcae3-6f0c-45c7-ae98-8176006ea7b3 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:55.177532 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5edcae3-6f0c-45c7-ae98-8176006ea7b3 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:55.178128 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5edcae3-6f0c-45c7-ae98-8176006ea7b3 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:55.179339 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5edcae3-6f0c-45c7-ae98-8176006ea7b3 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:55.180216 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5edcae3-6f0c-45c7-ae98-8176006ea7b3 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:55.180824 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5edcae3-6f0c-45c7-ae98-8176006ea7b3 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:55.339936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f5edcae3-6f0c-45c7-ae98-8176006ea7b3 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:55.349447 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f5edcae3-6f0c-45c7-ae98-8176006ea7b3 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1567 microversion: 2.1 time: 0.186104 Aug 19 15:33:55.350126 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 521/1032] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:55 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:56.371221 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5476412d-7a76-4dfd-b35f-4d59403fb176 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:56.372462 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5476412d-7a76-4dfd-b35f-4d59403fb176 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:56.379905 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:33:56.382239 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5476412d-7a76-4dfd-b35f-4d59403fb176 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:56.382887 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5476412d-7a76-4dfd-b35f-4d59403fb176 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:56.383499 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5476412d-7a76-4dfd-b35f-4d59403fb176 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:56.384357 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5476412d-7a76-4dfd-b35f-4d59403fb176 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:56.384979 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5476412d-7a76-4dfd-b35f-4d59403fb176 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:56.385555 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5476412d-7a76-4dfd-b35f-4d59403fb176 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:56.532120 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5476412d-7a76-4dfd-b35f-4d59403fb176 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:56.534363 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:33:56.541778 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5476412d-7a76-4dfd-b35f-4d59403fb176 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1567 microversion: 2.1 time: 0.174482 Aug 19 15:33:56.542359 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 512/1033] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:56 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:33:57.564952 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aa4d8448-a8e6-408f-90ef-b8a52a5f8431 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:57.566275 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aa4d8448-a8e6-408f-90ef-b8a52a5f8431 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:57.573163 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:33:57.582887 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa4d8448-a8e6-408f-90ef-b8a52a5f8431 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:57.583940 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa4d8448-a8e6-408f-90ef-b8a52a5f8431 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:57.586500 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa4d8448-a8e6-408f-90ef-b8a52a5f8431 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:57.587300 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa4d8448-a8e6-408f-90ef-b8a52a5f8431 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:57.587769 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa4d8448-a8e6-408f-90ef-b8a52a5f8431 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:57.588193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa4d8448-a8e6-408f-90ef-b8a52a5f8431 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:57.745328 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-aa4d8448-a8e6-408f-90ef-b8a52a5f8431 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:57.753936 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aa4d8448-a8e6-408f-90ef-b8a52a5f8431 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1567 microversion: 2.1 time: 0.194699 Aug 19 15:33:57.754508 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 522/1034] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:57 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:58.775703 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-06642266-6141-47e6-9643-c7e8239a526a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:58.776489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-06642266-6141-47e6-9643-c7e8239a526a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:58.784733 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06642266-6141-47e6-9643-c7e8239a526a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:58.785250 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06642266-6141-47e6-9643-c7e8239a526a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:58.785686 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06642266-6141-47e6-9643-c7e8239a526a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:58.786396 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06642266-6141-47e6-9643-c7e8239a526a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:58.786849 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06642266-6141-47e6-9643-c7e8239a526a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:58.787276 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06642266-6141-47e6-9643-c7e8239a526a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:58.918553 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-06642266-6141-47e6-9643-c7e8239a526a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:33:58.926388 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-06642266-6141-47e6-9643-c7e8239a526a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1567 microversion: 2.1 time: 0.155060 Aug 19 15:33:58.926954 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 513/1035] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:58 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:33:59.947679 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8c5691e5-37ea-4b22-88df-572f36f0afe9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:33:59.948288 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8c5691e5-37ea-4b22-88df-572f36f0afe9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:33:59.955601 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c5691e5-37ea-4b22-88df-572f36f0afe9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:59.956083 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c5691e5-37ea-4b22-88df-572f36f0afe9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:59.956557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c5691e5-37ea-4b22-88df-572f36f0afe9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:33:59.957267 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c5691e5-37ea-4b22-88df-572f36f0afe9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:33:59.957724 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c5691e5-37ea-4b22-88df-572f36f0afe9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:33:59.958149 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c5691e5-37ea-4b22-88df-572f36f0afe9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:00.097201 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8c5691e5-37ea-4b22-88df-572f36f0afe9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:00.104951 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8c5691e5-37ea-4b22-88df-572f36f0afe9 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1568 microversion: 2.1 time: 0.161811 Aug 19 15:34:00.105509 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 523/1036] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:33:59 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:34:00.126001 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-748449d1-a6aa-4713-aca6-9755092f6e29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:34:00.126602 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-748449d1-a6aa-4713-aca6-9755092f6e29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:00.133321 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-748449d1-a6aa-4713-aca6-9755092f6e29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:00.133800 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-748449d1-a6aa-4713-aca6-9755092f6e29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:00.134235 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-748449d1-a6aa-4713-aca6-9755092f6e29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:00.134920 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-748449d1-a6aa-4713-aca6-9755092f6e29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:00.135373 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-748449d1-a6aa-4713-aca6-9755092f6e29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:00.135796 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-748449d1-a6aa-4713-aca6-9755092f6e29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:00.164608 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-748449d1-a6aa-4713-aca6-9755092f6e29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120637) unshelve /opt/stack/nova/nova/compute/api.py:4584}} Aug 19 15:34:00.231829 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-748449d1-a6aa-4713-aca6-9755092f6e29 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "POST /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065/action" status: 202 len: 0 microversion: 2.1 time: 0.110173 Aug 19 15:34:00.233069 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 514/1037] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Aug 19 15:34:00 2022] POST /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:34:00.243068 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-133056cf-15ae-44b7-9b2e-262133e9efa8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:00.243894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-133056cf-15ae-44b7-9b2e-262133e9efa8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:00.249840 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-133056cf-15ae-44b7-9b2e-262133e9efa8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:00.250371 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-133056cf-15ae-44b7-9b2e-262133e9efa8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:00.250812 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-133056cf-15ae-44b7-9b2e-262133e9efa8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:00.251550 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-133056cf-15ae-44b7-9b2e-262133e9efa8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:00.252011 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-133056cf-15ae-44b7-9b2e-262133e9efa8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:00.252460 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-133056cf-15ae-44b7-9b2e-262133e9efa8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:00.402916 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-133056cf-15ae-44b7-9b2e-262133e9efa8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:00.412257 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-133056cf-15ae-44b7-9b2e-262133e9efa8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1576 microversion: 2.1 time: 0.174250 Aug 19 15:34:00.412965 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 524/1038] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:34:00 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:34:01.434314 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7fdaa14-a741-41b4-91ec-61e36ab68f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:01.434923 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7fdaa14-a741-41b4-91ec-61e36ab68f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:01.441514 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7fdaa14-a741-41b4-91ec-61e36ab68f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:01.441991 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7fdaa14-a741-41b4-91ec-61e36ab68f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:01.442421 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7fdaa14-a741-41b4-91ec-61e36ab68f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:01.443193 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7fdaa14-a741-41b4-91ec-61e36ab68f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:01.443651 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7fdaa14-a741-41b4-91ec-61e36ab68f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:01.444071 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7fdaa14-a741-41b4-91ec-61e36ab68f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:01.589779 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7fdaa14-a741-41b4-91ec-61e36ab68f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:01.598362 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7fdaa14-a741-41b4-91ec-61e36ab68f3a tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1518 microversion: 2.1 time: 0.167880 Aug 19 15:34:01.598937 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 515/1039] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:34:01 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:34:02.619093 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d130efef-79ce-437c-b835-162d15d15426 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:02.619705 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d130efef-79ce-437c-b835-162d15d15426 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:02.626321 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d130efef-79ce-437c-b835-162d15d15426 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:02.626806 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d130efef-79ce-437c-b835-162d15d15426 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:02.627237 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d130efef-79ce-437c-b835-162d15d15426 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:02.627937 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d130efef-79ce-437c-b835-162d15d15426 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:02.628406 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d130efef-79ce-437c-b835-162d15d15426 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:02.628839 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d130efef-79ce-437c-b835-162d15d15426 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:02.761708 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d130efef-79ce-437c-b835-162d15d15426 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:02.769542 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d130efef-79ce-437c-b835-162d15d15426 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1574 microversion: 2.1 time: 0.154368 Aug 19 15:34:02.770103 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 525/1040] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:34:02 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:34:03.787733 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-6820c7d8-0bcb-4635-ad7c-7202ec1a384a req-46762d8a-8555-4751-abd6-17702b4fe0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446054b4-8b4f-45ec-9e9b-4a552af02065", "name": "network-vif-unplugged", "status": "completed", "tag": "202d895f-8706-4b55-b8a7-80568bae22d1"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:34:03.791734 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4f51dca0-cb49-4cef-921e-458dad87c0f2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:03.793076 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4f51dca0-cb49-4cef-921e-458dad87c0f2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:03.797921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-6820c7d8-0bcb-4635-ad7c-7202ec1a384a req-46762d8a-8555-4751-abd6-17702b4fe0f9 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:03.797921 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-6820c7d8-0bcb-4635-ad7c-7202ec1a384a req-46762d8a-8555-4751-abd6-17702b4fe0f9 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:03.798543 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-6820c7d8-0bcb-4635-ad7c-7202ec1a384a req-46762d8a-8555-4751-abd6-17702b4fe0f9 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:03.807010 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f51dca0-cb49-4cef-921e-458dad87c0f2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:03.807504 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f51dca0-cb49-4cef-921e-458dad87c0f2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:03.807940 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f51dca0-cb49-4cef-921e-458dad87c0f2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:03.808676 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f51dca0-cb49-4cef-921e-458dad87c0f2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:03.809132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f51dca0-cb49-4cef-921e-458dad87c0f2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:03.809558 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f51dca0-cb49-4cef-921e-458dad87c0f2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:03.810435 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-6820c7d8-0bcb-4635-ad7c-7202ec1a384a req-46762d8a-8555-4751-abd6-17702b4fe0f9 service nova] Creating event network-vif-unplugged:202d895f-8706-4b55-b8a7-80568bae22d1 for instance 446054b4-8b4f-45ec-9e9b-4a552af02065 on hv-cinder-83538 Aug 19 15:34:03.815651 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-6820c7d8-0bcb-4635-ad7c-7202ec1a384a req-46762d8a-8555-4751-abd6-17702b4fe0f9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093836 Aug 19 15:34:03.816251 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 516/1041] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:34:03.943557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4f51dca0-cb49-4cef-921e-458dad87c0f2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:03.951257 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4f51dca0-cb49-4cef-921e-458dad87c0f2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1574 microversion: 2.1 time: 0.164159 Aug 19 15:34:03.951808 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 526/1042] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:34:03 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:34:04.974058 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b289682b-c75b-44d1-9f31-4798e0e58615 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:04.974673 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b289682b-c75b-44d1-9f31-4798e0e58615 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:04.980806 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b289682b-c75b-44d1-9f31-4798e0e58615 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:04.981285 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b289682b-c75b-44d1-9f31-4798e0e58615 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:04.981715 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b289682b-c75b-44d1-9f31-4798e0e58615 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:04.982396 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b289682b-c75b-44d1-9f31-4798e0e58615 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:04.982846 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b289682b-c75b-44d1-9f31-4798e0e58615 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:04.983268 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b289682b-c75b-44d1-9f31-4798e0e58615 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:05.114223 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b289682b-c75b-44d1-9f31-4798e0e58615 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:05.121900 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b289682b-c75b-44d1-9f31-4798e0e58615 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1574 microversion: 2.1 time: 0.153170 Aug 19 15:34:05.122476 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 517/1043] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:34:04 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:34:06.144352 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0efb2847-4f82-4c9c-ad56-c2db64d7aa8b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:06.144979 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0efb2847-4f82-4c9c-ad56-c2db64d7aa8b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:06.151378 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0efb2847-4f82-4c9c-ad56-c2db64d7aa8b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:06.151852 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0efb2847-4f82-4c9c-ad56-c2db64d7aa8b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:06.152275 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0efb2847-4f82-4c9c-ad56-c2db64d7aa8b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:06.152985 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0efb2847-4f82-4c9c-ad56-c2db64d7aa8b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:06.153431 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0efb2847-4f82-4c9c-ad56-c2db64d7aa8b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:06.153848 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0efb2847-4f82-4c9c-ad56-c2db64d7aa8b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:06.288524 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0efb2847-4f82-4c9c-ad56-c2db64d7aa8b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:06.296584 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0efb2847-4f82-4c9c-ad56-c2db64d7aa8b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1574 microversion: 2.1 time: 0.157418 Aug 19 15:34:06.297199 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 527/1044] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:34:06 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:34:07.318184 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-17d02c60-e909-4d78-97a9-96d04ddfa9b5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:07.318864 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-17d02c60-e909-4d78-97a9-96d04ddfa9b5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:07.325490 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17d02c60-e909-4d78-97a9-96d04ddfa9b5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:07.325973 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17d02c60-e909-4d78-97a9-96d04ddfa9b5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:07.326406 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17d02c60-e909-4d78-97a9-96d04ddfa9b5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:07.327088 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17d02c60-e909-4d78-97a9-96d04ddfa9b5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:07.327542 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17d02c60-e909-4d78-97a9-96d04ddfa9b5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:07.327963 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17d02c60-e909-4d78-97a9-96d04ddfa9b5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:07.458144 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-17d02c60-e909-4d78-97a9-96d04ddfa9b5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:07.465790 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-17d02c60-e909-4d78-97a9-96d04ddfa9b5 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1574 microversion: 2.1 time: 0.151474 Aug 19 15:34:07.466365 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 518/1045] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:34:07 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:34:08.488179 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8b014603-cf44-42ac-887e-80b03edc2af2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:08.488885 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8b014603-cf44-42ac-887e-80b03edc2af2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:08.495205 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b014603-cf44-42ac-887e-80b03edc2af2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:08.495682 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b014603-cf44-42ac-887e-80b03edc2af2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:08.496112 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b014603-cf44-42ac-887e-80b03edc2af2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:08.496833 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b014603-cf44-42ac-887e-80b03edc2af2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:08.497282 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b014603-cf44-42ac-887e-80b03edc2af2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:08.497699 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b014603-cf44-42ac-887e-80b03edc2af2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:08.500186 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:34:08.632131 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8b014603-cf44-42ac-887e-80b03edc2af2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:08.639888 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8b014603-cf44-42ac-887e-80b03edc2af2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1574 microversion: 2.1 time: 0.156192 Aug 19 15:34:08.640472 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 528/1046] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:34:08 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:34:09.660916 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e42f509d-4508-4454-8e78-942031e62563 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:09.661564 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e42f509d-4508-4454-8e78-942031e62563 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:09.668258 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42f509d-4508-4454-8e78-942031e62563 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:09.669002 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42f509d-4508-4454-8e78-942031e62563 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:09.669213 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42f509d-4508-4454-8e78-942031e62563 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:09.669912 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42f509d-4508-4454-8e78-942031e62563 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:09.670367 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42f509d-4508-4454-8e78-942031e62563 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:09.670793 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42f509d-4508-4454-8e78-942031e62563 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:09.806855 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e42f509d-4508-4454-8e78-942031e62563 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:09.815313 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e42f509d-4508-4454-8e78-942031e62563 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1574 microversion: 2.1 time: 0.158273 Aug 19 15:34:09.815894 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 519/1047] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:34:09 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:34:10.835028 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4bb4d6c7-c4dd-4041-8016-e74ccf10b32c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:10.835629 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4bb4d6c7-c4dd-4041-8016-e74ccf10b32c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:10.842123 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bb4d6c7-c4dd-4041-8016-e74ccf10b32c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:10.842598 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bb4d6c7-c4dd-4041-8016-e74ccf10b32c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:10.843021 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bb4d6c7-c4dd-4041-8016-e74ccf10b32c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:10.843701 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bb4d6c7-c4dd-4041-8016-e74ccf10b32c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:10.844148 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bb4d6c7-c4dd-4041-8016-e74ccf10b32c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:10.845140 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bb4d6c7-c4dd-4041-8016-e74ccf10b32c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:10.976188 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4bb4d6c7-c4dd-4041-8016-e74ccf10b32c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:10.984049 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4bb4d6c7-c4dd-4041-8016-e74ccf10b32c tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1561 microversion: 2.1 time: 0.152876 Aug 19 15:34:10.984648 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 529/1048] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:34:10 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:34:11.822603 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-b7079227-b40c-489d-ab5d-0e9639d11e2b req-e69644b2-adc0-423f-9b27-05fcceee62f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446054b4-8b4f-45ec-9e9b-4a552af02065", "name": "network-vif-plugged", "status": "completed", "tag": "202d895f-8706-4b55-b8a7-80568bae22d1"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:34:11.834689 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b7079227-b40c-489d-ab5d-0e9639d11e2b req-e69644b2-adc0-423f-9b27-05fcceee62f6 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:11.835189 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b7079227-b40c-489d-ab5d-0e9639d11e2b req-e69644b2-adc0-423f-9b27-05fcceee62f6 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:11.835613 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b7079227-b40c-489d-ab5d-0e9639d11e2b req-e69644b2-adc0-423f-9b27-05fcceee62f6 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:11.848027 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-b7079227-b40c-489d-ab5d-0e9639d11e2b req-e69644b2-adc0-423f-9b27-05fcceee62f6 service nova] Creating event network-vif-plugged:202d895f-8706-4b55-b8a7-80568bae22d1 for instance 446054b4-8b4f-45ec-9e9b-4a552af02065 on hv-cinder-83538 Aug 19 15:34:11.853035 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-b7079227-b40c-489d-ab5d-0e9639d11e2b req-e69644b2-adc0-423f-9b27-05fcceee62f6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034183 Aug 19 15:34:11.853656 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 520/1049] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:34:20.479544 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d8e0abe0-cc75-4ad2-8065-a942b73bf20e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:20.481748 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d8e0abe0-cc75-4ad2-8065-a942b73bf20e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:20.488172 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8e0abe0-cc75-4ad2-8065-a942b73bf20e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:20.488688 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8e0abe0-cc75-4ad2-8065-a942b73bf20e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:20.489132 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8e0abe0-cc75-4ad2-8065-a942b73bf20e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:20.489822 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8e0abe0-cc75-4ad2-8065-a942b73bf20e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:20.490274 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8e0abe0-cc75-4ad2-8065-a942b73bf20e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:20.490698 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8e0abe0-cc75-4ad2-8065-a942b73bf20e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:20.520685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d8e0abe0-cc75-4ad2-8065-a942b73bf20e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044997 Aug 19 15:34:20.521170 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 530/1050] 10.222.0.75 () {60 vars in 1343 bytes} [Fri Aug 19 15:34:20 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:34:20.584442 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-46948aca-7db7-444f-b604-e0e035c239d0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:20.585026 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-46948aca-7db7-444f-b604-e0e035c239d0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:20.591059 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46948aca-7db7-444f-b604-e0e035c239d0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:20.591528 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46948aca-7db7-444f-b604-e0e035c239d0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:20.591949 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46948aca-7db7-444f-b604-e0e035c239d0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:20.592646 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46948aca-7db7-444f-b604-e0e035c239d0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:20.593090 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46948aca-7db7-444f-b604-e0e035c239d0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:20.593505 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46948aca-7db7-444f-b604-e0e035c239d0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:20.618823 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-46948aca-7db7-444f-b604-e0e035c239d0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:34:20.698610 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-46948aca-7db7-444f-b604-e0e035c239d0 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 204 len: 0 microversion: 2.20 time: 0.118874 Aug 19 15:34:20.699212 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 521/1051] 10.222.0.75 () {60 vars in 1280 bytes} [Fri Aug 19 15:34:20 2022] DELETE /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 19 15:34:20.707955 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-edb51c09-dc2b-4d7a-b034-d5d630fd652d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:20.708548 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-edb51c09-dc2b-4d7a-b034-d5d630fd652d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:20.714445 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edb51c09-dc2b-4d7a-b034-d5d630fd652d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:20.714919 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edb51c09-dc2b-4d7a-b034-d5d630fd652d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:20.715344 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edb51c09-dc2b-4d7a-b034-d5d630fd652d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:20.716019 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edb51c09-dc2b-4d7a-b034-d5d630fd652d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:20.716496 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edb51c09-dc2b-4d7a-b034-d5d630fd652d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:20.716915 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edb51c09-dc2b-4d7a-b034-d5d630fd652d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:20.849686 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-edb51c09-dc2b-4d7a-b034-d5d630fd652d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:20.857862 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-edb51c09-dc2b-4d7a-b034-d5d630fd652d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:20.859362 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-edb51c09-dc2b-4d7a-b034-d5d630fd652d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:20.860601 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-edb51c09-dc2b-4d7a-b034-d5d630fd652d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1722 microversion: 2.20 time: 0.157101 Aug 19 15:34:20.861159 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 531/1052] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:34:20 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:34:21.883907 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0dde4c6b-2afd-46e9-a00a-bf551d76d9c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:21.884546 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0dde4c6b-2afd-46e9-a00a-bf551d76d9c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:21.891039 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dde4c6b-2afd-46e9-a00a-bf551d76d9c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:21.891647 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dde4c6b-2afd-46e9-a00a-bf551d76d9c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:21.892081 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dde4c6b-2afd-46e9-a00a-bf551d76d9c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:21.892799 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dde4c6b-2afd-46e9-a00a-bf551d76d9c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:21.893244 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dde4c6b-2afd-46e9-a00a-bf551d76d9c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:21.893666 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dde4c6b-2afd-46e9-a00a-bf551d76d9c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:22.028759 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0dde4c6b-2afd-46e9-a00a-bf551d76d9c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:22.037628 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0dde4c6b-2afd-46e9-a00a-bf551d76d9c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:22.039137 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0dde4c6b-2afd-46e9-a00a-bf551d76d9c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:22.040294 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0dde4c6b-2afd-46e9-a00a-bf551d76d9c7 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1722 microversion: 2.20 time: 0.160770 Aug 19 15:34:22.040887 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 522/1053] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:34:21 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 15:34:23.063209 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0c916089-9b96-4366-80f9-6e17ba5fa97e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:23.064929 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0c916089-9b96-4366-80f9-6e17ba5fa97e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:23.071863 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c916089-9b96-4366-80f9-6e17ba5fa97e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:23.072338 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c916089-9b96-4366-80f9-6e17ba5fa97e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:23.072801 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c916089-9b96-4366-80f9-6e17ba5fa97e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:23.073484 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c916089-9b96-4366-80f9-6e17ba5fa97e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:23.073960 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c916089-9b96-4366-80f9-6e17ba5fa97e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:23.074376 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c916089-9b96-4366-80f9-6e17ba5fa97e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:23.151326 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0c916089-9b96-4366-80f9-6e17ba5fa97e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:23.160155 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-4f41d312-ed59-4845-a77d-031f2e478e62 req-fc540b55-47c5-4b75-aad6-b5b905d08241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f43980-62ff-449e-bcbf-6aef66451613", "name": "network-vif-deleted", "tag": "1123119a-1372-416f-b5f1-586c7ed3bbd7"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:34:23.163114 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0c916089-9b96-4366-80f9-6e17ba5fa97e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:23.167618 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0c916089-9b96-4366-80f9-6e17ba5fa97e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '821d38464cd3491e81e94d809930d076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981bbb7282bd40d0b5335280d5041fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:34:23.169328 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0c916089-9b96-4366-80f9-6e17ba5fa97e tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 200 len: 1654 microversion: 2.20 time: 0.110089 Aug 19 15:34:23.170801 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 532/1054] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:34:23 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 1654 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 15:34:23.173076 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4f41d312-ed59-4845-a77d-031f2e478e62 req-fc540b55-47c5-4b75-aad6-b5b905d08241 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:23.173803 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4f41d312-ed59-4845-a77d-031f2e478e62 req-fc540b55-47c5-4b75-aad6-b5b905d08241 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:23.173959 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4f41d312-ed59-4845-a77d-031f2e478e62 req-fc540b55-47c5-4b75-aad6-b5b905d08241 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:23.186178 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-4f41d312-ed59-4845-a77d-031f2e478e62 req-fc540b55-47c5-4b75-aad6-b5b905d08241 service nova] Creating event network-vif-deleted:1123119a-1372-416f-b5f1-586c7ed3bbd7 for instance a3f43980-62ff-449e-bcbf-6aef66451613 on hv-cinder-83538 Aug 19 15:34:23.191994 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-4f41d312-ed59-4845-a77d-031f2e478e62 req-fc540b55-47c5-4b75-aad6-b5b905d08241 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035611 Aug 19 15:34:23.193222 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 523/1055] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:34:24.194216 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2f006f99-4f0f-4cbf-9d23-a0b4986a1dd3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:24.194819 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2f006f99-4f0f-4cbf-9d23-a0b4986a1dd3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:24.201314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f006f99-4f0f-4cbf-9d23-a0b4986a1dd3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:24.201815 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f006f99-4f0f-4cbf-9d23-a0b4986a1dd3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:24.202241 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f006f99-4f0f-4cbf-9d23-a0b4986a1dd3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:24.202924 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f006f99-4f0f-4cbf-9d23-a0b4986a1dd3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:24.203371 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f006f99-4f0f-4cbf-9d23-a0b4986a1dd3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:24.203852 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f006f99-4f0f-4cbf-9d23-a0b4986a1dd3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:24.217877 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-2f006f99-4f0f-4cbf-9d23-a0b4986a1dd3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] HTTP exception thrown: Instance a3f43980-62ff-449e-bcbf-6aef66451613 could not be found. Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2f006f99-4f0f-4cbf-9d23-a0b4986a1dd3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Request method failure captured: Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 HTTP/1.1 Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6xBZR_bfQHg5vENWJDsV2cV3_x9HY76W3WvFBnowNHGN4ZOn0NNRl8CYtVgT7EgMd7GMxuQZc3_bctV8TtO2SOP54nCLHYbRalFYJoQdQjHq6qc3xG3Qzoqs0wYlGIN3tJZhMsy_xC07h5ljHxiXwVxYuojlrEDsnmRaIxAO4QkJJ4 Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Openstack-Nova-Api-Version: 2.20 Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: 981bbb7282bd40d0b5335280d5041fa5 Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2021484624 Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:34:24.221200 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:34:24.222984 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_981bbb7282bd40d0b5335280d5041fa5", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/981bbb7282bd40d0b5335280d5041fa5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/981bbb7282bd40d0b5335280d5041fa5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/981bbb7282bd40d0b5335280d5041fa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:34:24.222984 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2021484624 Aug 19 15:34:24.222984 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 981bbb7282bd40d0b5335280d5041fa5 Aug 19 15:34:24.222984 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2021484624 Aug 19 15:34:24.222984 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeShelveTestJSON-2021484624-project Aug 19 15:34:24.222984 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:34:24.222984 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:34:24.222984 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 821d38464cd3491e81e94d809930d076 Aug 19 15:34:24.222984 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2021484624-project Aug 19 15:34:24.222984 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:34:24.222984 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance a3f43980-62ff-449e-bcbf-6aef66451613 could not be found. Aug 19 15:34:24.222984 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': 'a3f43980-62ff-449e-bcbf-6aef66451613'} Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f43980-62ff-449e-bcbf-6aef66451613 could not be found. Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:34:24.223959 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:34:24.225585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:34:24.225585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:34:24.225585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:34:24.225585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:34:24.225585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:34:24.225585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:34:24.225585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:34:24.225585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f43980-62ff-449e-bcbf-6aef66451613 could not be found. Aug 19 15:34:24.225585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:34:24.225585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:34:24.225585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:34:24.225585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:34:24.225585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:34:24.225585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:34:24.225585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:34:24.225585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:34:24.225585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f43980-62ff-449e-bcbf-6aef66451613 could not be found. Aug 19 15:34:24.225585 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:34:24.227031 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2f006f99-4f0f-4cbf-9d23-a0b4986a1dd3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Returning 404 to user: Instance a3f43980-62ff-449e-bcbf-6aef66451613 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:34:24.227031 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2f006f99-4f0f-4cbf-9d23-a0b4986a1dd3 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 404 len: 111 microversion: 2.20 time: 0.032835 Aug 19 15:34:24.227031 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 533/1056] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:34:24 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 19 15:34:24.233147 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-12a06fcb-d382-44aa-be04-31910d109157 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '.version_select at 0x7fb533432af0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:24.238335 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR oslo.messaging._drivers.impl_rabbit [None req-12a06fcb-d382-44aa-be04-31910d109157 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [ee293706-0597-4e88-be25-db19fde266e9] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 19 15:34:25.245473 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [None req-12a06fcb-d382-44aa-be04-31910d109157 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [ee293706-0597-4e88-be25-db19fde266e9] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 46786. Aug 19 15:34:25.263785 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-12a06fcb-d382-44aa-be04-31910d109157 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2078260445" status: 204 len: 0 microversion: 2.20 time: 1.034704 Aug 19 15:34:25.264374 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 524/1057] 10.222.0.75 () {60 vars in 1262 bytes} [Fri Aug 19 15:34:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2078260445 => generated 0 bytes in 1036 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 19 15:34:27.006742 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9373cc9b-c6b3-4ef6-a67d-d4b9ef5c07bf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:27.007253 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9373cc9b-c6b3-4ef6-a67d-d4b9ef5c07bf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:27.013537 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9373cc9b-c6b3-4ef6-a67d-d4b9ef5c07bf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:27.014011 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9373cc9b-c6b3-4ef6-a67d-d4b9ef5c07bf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:27.014436 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9373cc9b-c6b3-4ef6-a67d-d4b9ef5c07bf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:27.015114 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9373cc9b-c6b3-4ef6-a67d-d4b9ef5c07bf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:27.015555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9373cc9b-c6b3-4ef6-a67d-d4b9ef5c07bf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:27.015970 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9373cc9b-c6b3-4ef6-a67d-d4b9ef5c07bf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:27.029810 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-9373cc9b-c6b3-4ef6-a67d-d4b9ef5c07bf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] HTTP exception thrown: Instance a3f43980-62ff-449e-bcbf-6aef66451613 could not be found. Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9373cc9b-c6b3-4ef6-a67d-d4b9ef5c07bf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Request method failure captured: Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 HTTP/1.1 Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6xBZR_bfQHg5vENWJDsV2cV3_x9HY76W3WvFBnowNHGN4ZOn0NNRl8CYtVgT7EgMd7GMxuQZc3_bctV8TtO2SOP54nCLHYbRalFYJoQdQjHq6qc3xG3Qzoqs0wYlGIN3tJZhMsy_xC07h5ljHxiXwVxYuojlrEDsnmRaIxAO4QkJJ4 Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Openstack-Nova-Api-Version: 2.20 Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: 981bbb7282bd40d0b5335280d5041fa5 Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2021484624 Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:34:27.031330 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:34:27.033814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_981bbb7282bd40d0b5335280d5041fa5", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/981bbb7282bd40d0b5335280d5041fa5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/981bbb7282bd40d0b5335280d5041fa5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/981bbb7282bd40d0b5335280d5041fa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:34:27.033814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2021484624 Aug 19 15:34:27.033814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 981bbb7282bd40d0b5335280d5041fa5 Aug 19 15:34:27.033814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2021484624 Aug 19 15:34:27.033814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeShelveTestJSON-2021484624-project Aug 19 15:34:27.033814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:34:27.033814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:34:27.033814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 821d38464cd3491e81e94d809930d076 Aug 19 15:34:27.033814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2021484624-project Aug 19 15:34:27.033814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:34:27.033814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance a3f43980-62ff-449e-bcbf-6aef66451613 could not be found. Aug 19 15:34:27.033814 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': 'a3f43980-62ff-449e-bcbf-6aef66451613'} Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f43980-62ff-449e-bcbf-6aef66451613 could not be found. Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:34:27.034685 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f43980-62ff-449e-bcbf-6aef66451613 could not be found. Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f43980-62ff-449e-bcbf-6aef66451613 could not be found. Aug 19 15:34:27.035963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:34:27.037277 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9373cc9b-c6b3-4ef6-a67d-d4b9ef5c07bf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Returning 404 to user: Instance a3f43980-62ff-449e-bcbf-6aef66451613 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:34:27.037277 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9373cc9b-c6b3-4ef6-a67d-d4b9ef5c07bf tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 404 len: 111 microversion: 2.20 time: 0.030776 Aug 19 15:34:27.037277 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 534/1058] 10.222.0.75 () {60 vars in 1280 bytes} [Fri Aug 19 15:34:27 2022] DELETE /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 19 15:34:27.042853 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d1ad3311-8ef2-47d5-89c4-3c6a70ba63d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:27.043587 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d1ad3311-8ef2-47d5-89c4-3c6a70ba63d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: a3f43980-62ff-449e-bcbf-6aef66451613] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:27.045527 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:34:27.051875 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ad3311-8ef2-47d5-89c4-3c6a70ba63d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:27.052356 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ad3311-8ef2-47d5-89c4-3c6a70ba63d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:27.052809 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ad3311-8ef2-47d5-89c4-3c6a70ba63d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:27.053496 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ad3311-8ef2-47d5-89c4-3c6a70ba63d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:27.053944 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ad3311-8ef2-47d5-89c4-3c6a70ba63d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:27.054635 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ad3311-8ef2-47d5-89c4-3c6a70ba63d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:27.069359 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-d1ad3311-8ef2-47d5-89c4-3c6a70ba63d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] HTTP exception thrown: Instance a3f43980-62ff-449e-bcbf-6aef66451613 could not be found. Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d1ad3311-8ef2-47d5-89c4-3c6a70ba63d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Request method failure captured: Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 HTTP/1.1 Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6xBZR_bfQHg5vENWJDsV2cV3_x9HY76W3WvFBnowNHGN4ZOn0NNRl8CYtVgT7EgMd7GMxuQZc3_bctV8TtO2SOP54nCLHYbRalFYJoQdQjHq6qc3xG3Qzoqs0wYlGIN3tJZhMsy_xC07h5ljHxiXwVxYuojlrEDsnmRaIxAO4QkJJ4 Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Openstack-Nova-Api-Version: 2.20 Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: 981bbb7282bd40d0b5335280d5041fa5 Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2021484624 Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:34:27.070960 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:34:27.072728 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_981bbb7282bd40d0b5335280d5041fa5", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/981bbb7282bd40d0b5335280d5041fa5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/981bbb7282bd40d0b5335280d5041fa5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/981bbb7282bd40d0b5335280d5041fa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:34:27.072728 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2021484624 Aug 19 15:34:27.072728 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 981bbb7282bd40d0b5335280d5041fa5 Aug 19 15:34:27.072728 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2021484624 Aug 19 15:34:27.072728 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeShelveTestJSON-2021484624-project Aug 19 15:34:27.072728 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:34:27.072728 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:34:27.072728 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: 821d38464cd3491e81e94d809930d076 Aug 19 15:34:27.072728 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2021484624-project Aug 19 15:34:27.072728 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:34:27.072728 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Instance a3f43980-62ff-449e-bcbf-6aef66451613 could not be found. Aug 19 15:34:27.072728 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': 'a3f43980-62ff-449e-bcbf-6aef66451613'} Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f43980-62ff-449e-bcbf-6aef66451613 could not be found. Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:34:27.073644 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:34:27.075152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:34:27.075152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:34:27.075152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:34:27.075152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:34:27.075152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:34:27.075152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:34:27.075152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:34:27.075152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f43980-62ff-449e-bcbf-6aef66451613 could not be found. Aug 19 15:34:27.075152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:34:27.075152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:34:27.075152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:34:27.075152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:34:27.075152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:34:27.075152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:34:27.075152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:34:27.075152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:34:27.075152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f43980-62ff-449e-bcbf-6aef66451613 could not be found. Aug 19 15:34:27.075152 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:34:27.076657 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d1ad3311-8ef2-47d5-89c4-3c6a70ba63d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Returning 404 to user: Instance a3f43980-62ff-449e-bcbf-6aef66451613 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:34:27.076657 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d1ad3311-8ef2-47d5-89c4-3c6a70ba63d2 tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613" status: 404 len: 111 microversion: 2.20 time: 0.033861 Aug 19 15:34:27.076657 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 525/1059] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:34:27 2022] GET /compute/v2.1/servers/a3f43980-62ff-449e-bcbf-6aef66451613 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 19 15:34:28.216516 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1efc7995-cf1a-4851-8468-3241e7f9d75d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:28.217013 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1efc7995-cf1a-4851-8468-3241e7f9d75d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:28.219359 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=26 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:34:28.225299 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1efc7995-cf1a-4851-8468-3241e7f9d75d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:28.225786 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1efc7995-cf1a-4851-8468-3241e7f9d75d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:28.226219 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1efc7995-cf1a-4851-8468-3241e7f9d75d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:28.226906 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1efc7995-cf1a-4851-8468-3241e7f9d75d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:28.227352 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1efc7995-cf1a-4851-8468-3241e7f9d75d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:28.227777 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1efc7995-cf1a-4851-8468-3241e7f9d75d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:28.241127 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-1efc7995-cf1a-4851-8468-3241e7f9d75d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] HTTP exception thrown: Instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd could not be found. Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1efc7995-cf1a-4851-8468-3241e7f9d75d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Request method failure captured: Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd HTTP/1.1 Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6xBZR_bfQHg5vENWJDsV2cV3_x9HY76W3WvFBnowNHGN4ZOn0NNRl8CYtVgT7EgMd7GMxuQZc3_bctV8TtO2SOP54nCLHYbRalFYJoQdQjHq6qc3xG3Qzoqs0wYlGIN3tJZhMsy_xC07h5ljHxiXwVxYuojlrEDsnmRaIxAO4QkJJ4 Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Openstack-Nova-Api-Version: 2.20 Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: 981bbb7282bd40d0b5335280d5041fa5 Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2021484624 Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:34:28.242669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:34:28.244375 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_981bbb7282bd40d0b5335280d5041fa5", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/981bbb7282bd40d0b5335280d5041fa5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/981bbb7282bd40d0b5335280d5041fa5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/981bbb7282bd40d0b5335280d5041fa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:34:28.244375 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2021484624 Aug 19 15:34:28.244375 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 981bbb7282bd40d0b5335280d5041fa5 Aug 19 15:34:28.244375 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2021484624 Aug 19 15:34:28.244375 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeShelveTestJSON-2021484624-project Aug 19 15:34:28.244375 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:34:28.244375 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:34:28.244375 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 821d38464cd3491e81e94d809930d076 Aug 19 15:34:28.244375 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2021484624-project Aug 19 15:34:28.244375 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:34:28.244375 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd could not be found. Aug 19 15:34:28.244375 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': '08b2c2fe-ead2-4d92-b4fb-dc42b41094fd'} Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd could not be found. Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:34:28.245314 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd could not be found. Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd could not be found. Aug 19 15:34:28.246867 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:34:28.248450 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1efc7995-cf1a-4851-8468-3241e7f9d75d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Returning 404 to user: Instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:34:28.248450 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1efc7995-cf1a-4851-8468-3241e7f9d75d tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "DELETE /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 404 len: 111 microversion: 2.20 time: 0.031476 Aug 19 15:34:28.248450 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 535/1060] 10.222.0.75 () {60 vars in 1280 bytes} [Fri Aug 19 15:34:28 2022] DELETE /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 19 15:34:28.253067 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-174a8ee7-a77c-4c64-823a-78c7a3e2913f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:34:28.253707 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-174a8ee7-a77c-4c64-823a-78c7a3e2913f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] [instance: 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:34:28.259759 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-174a8ee7-a77c-4c64-823a-78c7a3e2913f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:28.260234 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-174a8ee7-a77c-4c64-823a-78c7a3e2913f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:28.260695 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-174a8ee7-a77c-4c64-823a-78c7a3e2913f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:28.261372 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-174a8ee7-a77c-4c64-823a-78c7a3e2913f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:34:28.261820 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-174a8ee7-a77c-4c64-823a-78c7a3e2913f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:34:28.262245 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-174a8ee7-a77c-4c64-823a-78c7a3e2913f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:34:28.276207 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-174a8ee7-a77c-4c64-823a-78c7a3e2913f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] HTTP exception thrown: Instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd could not be found. Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-174a8ee7-a77c-4c64-823a-78c7a3e2913f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Request method failure captured: Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd HTTP/1.1 Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_6xBZR_bfQHg5vENWJDsV2cV3_x9HY76W3WvFBnowNHGN4ZOn0NNRl8CYtVgT7EgMd7GMxuQZc3_bctV8TtO2SOP54nCLHYbRalFYJoQdQjHq6qc3xG3Qzoqs0wYlGIN3tJZhMsy_xC07h5ljHxiXwVxYuojlrEDsnmRaIxAO4QkJJ4 Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Openstack-Nova-Api-Version: 2.20 Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: 981bbb7282bd40d0b5335280d5041fa5 Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2021484624 Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:34:28.277758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:34:28.279461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_981bbb7282bd40d0b5335280d5041fa5", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/981bbb7282bd40d0b5335280d5041fa5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/981bbb7282bd40d0b5335280d5041fa5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/981bbb7282bd40d0b5335280d5041fa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:34:28.279461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2021484624 Aug 19 15:34:28.279461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 981bbb7282bd40d0b5335280d5041fa5 Aug 19 15:34:28.279461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2021484624 Aug 19 15:34:28.279461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeShelveTestJSON-2021484624-project Aug 19 15:34:28.279461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:34:28.279461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:34:28.279461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: 821d38464cd3491e81e94d809930d076 Aug 19 15:34:28.279461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2021484624-project Aug 19 15:34:28.279461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:34:28.279461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd could not be found. Aug 19 15:34:28.279461 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': '08b2c2fe-ead2-4d92-b4fb-dc42b41094fd'} Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd could not be found. Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:34:28.280454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:34:28.282518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:34:28.282518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:34:28.282518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:34:28.282518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:34:28.282518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:34:28.282518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:34:28.282518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:34:28.282518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd could not be found. Aug 19 15:34:28.282518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:34:28.282518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:34:28.282518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:34:28.282518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:34:28.282518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:34:28.282518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:34:28.282518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:34:28.282518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:34:28.282518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd could not be found. Aug 19 15:34:28.282518 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:34:28.284100 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-174a8ee7-a77c-4c64-823a-78c7a3e2913f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] Returning 404 to user: Instance 08b2c2fe-ead2-4d92-b4fb-dc42b41094fd could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:34:28.284100 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-174a8ee7-a77c-4c64-823a-78c7a3e2913f tempest-AttachVolumeShelveTestJSON-2021484624 tempest-AttachVolumeShelveTestJSON-2021484624-project] 10.222.0.75 "GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd" status: 404 len: 111 microversion: 2.20 time: 0.030530 Aug 19 15:34:28.284100 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 526/1061] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Aug 19 15:34:28 2022] GET /compute/v2.1/servers/08b2c2fe-ead2-4d92-b4fb-dc42b41094fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 19 15:35:20.795626 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2bd1e5bc-63a0-4ad2-87fc-2fa8f62846e7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1448611661", "imageRef": "27174b76-85e7-4123-a2bc-847959ca59f2", "flavorRef": "452"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:35:20.802688 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:35:20.803324 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=35 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:35:20.851338 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-2bd1e5bc-63a0-4ad2-87fc-2fa8f62846e7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] validate_networks() for None {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 15:35:21.123615 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-2bd1e5bc-63a0-4ad2-87fc-2fa8f62846e7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 15:35:21.124029 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-2bd1e5bc-63a0-4ad2-87fc-2fa8f62846e7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 15:35:21.124527 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-2bd1e5bc-63a0-4ad2-87fc-2fa8f62846e7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 15:35:21.124958 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-2bd1e5bc-63a0-4ad2-87fc-2fa8f62846e7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 15:35:21.125361 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-2bd1e5bc-63a0-4ad2-87fc-2fa8f62846e7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 15:35:21.134246 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2bd1e5bc-63a0-4ad2-87fc-2fa8f62846e7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:21.134718 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2bd1e5bc-63a0-4ad2-87fc-2fa8f62846e7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:21.135193 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2bd1e5bc-63a0-4ad2-87fc-2fa8f62846e7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:21.136632 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2bd1e5bc-63a0-4ad2-87fc-2fa8f62846e7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:21.137086 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2bd1e5bc-63a0-4ad2-87fc-2fa8f62846e7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:21.137506 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2bd1e5bc-63a0-4ad2-87fc-2fa8f62846e7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:21.155055 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-2bd1e5bc-63a0-4ad2-87fc-2fa8f62846e7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Getting quotas for project 2558a7c80abd410bafa20a3aadc0e74d. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 15:35:21.158990 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-2bd1e5bc-63a0-4ad2-87fc-2fa8f62846e7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Getting quotas for user 72f1d4cb0e89482f916d6ee9bfe9bcb1 and project 2558a7c80abd410bafa20a3aadc0e74d. Resources: {'ram', 'cores', 'instances'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 15:35:21.170258 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2bd1e5bc-63a0-4ad2-87fc-2fa8f62846e7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 15:35:21.172589 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2bd1e5bc-63a0-4ad2-87fc-2fa8f62846e7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] [instance: 696874ca-88e5-4a6f-b3e6-21446e03bd78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27174b76-85e7-4123-a2bc-847959ca59f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 15:35:21.218276 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2bd1e5bc-63a0-4ad2-87fc-2fa8f62846e7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.426538 Aug 19 15:35:21.219044 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 536/1062] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Aug 19 15:35:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 15:35:21.230397 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c4028018-70bf-4aa7-9653-6b75071dda39 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:21.231003 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c4028018-70bf-4aa7-9653-6b75071dda39 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] [instance: 696874ca-88e5-4a6f-b3e6-21446e03bd78] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:21.233283 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:35:21.234106 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:35:21.288589 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c4028018-70bf-4aa7-9653-6b75071dda39 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f1d4cb0e89482f916d6ee9bfe9bcb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2558a7c80abd410bafa20a3aadc0e74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:35:21.296621 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c4028018-70bf-4aa7-9653-6b75071dda39 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] 10.222.0.75 "GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78" status: 200 len: 1215 microversion: 2.1 time: 0.070804 Aug 19 15:35:21.297220 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 527/1063] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:21 2022] GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:35:22.317588 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f2ad469b-3691-453e-8432-37f18e8426d1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:22.318365 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f2ad469b-3691-453e-8432-37f18e8426d1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] [instance: 696874ca-88e5-4a6f-b3e6-21446e03bd78] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:22.326115 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2ad469b-3691-453e-8432-37f18e8426d1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:22.326865 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2ad469b-3691-453e-8432-37f18e8426d1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:22.327295 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2ad469b-3691-453e-8432-37f18e8426d1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:22.328049 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2ad469b-3691-453e-8432-37f18e8426d1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:22.328527 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2ad469b-3691-453e-8432-37f18e8426d1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:22.328950 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2ad469b-3691-453e-8432-37f18e8426d1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:22.394910 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f2ad469b-3691-453e-8432-37f18e8426d1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f1d4cb0e89482f916d6ee9bfe9bcb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2558a7c80abd410bafa20a3aadc0e74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:35:22.404760 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f2ad469b-3691-453e-8432-37f18e8426d1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] 10.222.0.75 "GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78" status: 200 len: 1285 microversion: 2.1 time: 0.091107 Aug 19 15:35:22.405365 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 537/1064] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:22 2022] GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78 => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:35:23.427237 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd3f4168-2998-4cc1-af99-0ca188665ce1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:23.427820 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd3f4168-2998-4cc1-af99-0ca188665ce1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] [instance: 696874ca-88e5-4a6f-b3e6-21446e03bd78] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:23.436232 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd3f4168-2998-4cc1-af99-0ca188665ce1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:23.436743 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd3f4168-2998-4cc1-af99-0ca188665ce1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:23.437166 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd3f4168-2998-4cc1-af99-0ca188665ce1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:23.437889 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd3f4168-2998-4cc1-af99-0ca188665ce1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:23.438335 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd3f4168-2998-4cc1-af99-0ca188665ce1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:23.438750 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd3f4168-2998-4cc1-af99-0ca188665ce1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:23.577681 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fd3f4168-2998-4cc1-af99-0ca188665ce1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f1d4cb0e89482f916d6ee9bfe9bcb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2558a7c80abd410bafa20a3aadc0e74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:35:23.586176 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd3f4168-2998-4cc1-af99-0ca188665ce1 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] 10.222.0.75 "GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78" status: 200 len: 1315 microversion: 2.1 time: 0.162762 Aug 19 15:35:23.586956 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 528/1065] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:23 2022] GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:35:23.801282 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-4027e4fe-5fae-44a0-bb7f-878b059a79a2 req-c9f172b7-f3de-4be4-bad2-f9fdcc94551d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "696874ca-88e5-4a6f-b3e6-21446e03bd78", "tag": "b5f1aaf1-2ebf-40c5-9140-38fd09fed179"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:35:23.812369 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4027e4fe-5fae-44a0-bb7f-878b059a79a2 req-c9f172b7-f3de-4be4-bad2-f9fdcc94551d service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:23.812917 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4027e4fe-5fae-44a0-bb7f-878b059a79a2 req-c9f172b7-f3de-4be4-bad2-f9fdcc94551d service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:23.813335 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4027e4fe-5fae-44a0-bb7f-878b059a79a2 req-c9f172b7-f3de-4be4-bad2-f9fdcc94551d service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:23.825282 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-4027e4fe-5fae-44a0-bb7f-878b059a79a2 req-c9f172b7-f3de-4be4-bad2-f9fdcc94551d service nova] Creating event network-changed:b5f1aaf1-2ebf-40c5-9140-38fd09fed179 for instance 696874ca-88e5-4a6f-b3e6-21446e03bd78 on hv-cinder-83538 Aug 19 15:35:23.830376 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-4027e4fe-5fae-44a0-bb7f-878b059a79a2 req-c9f172b7-f3de-4be4-bad2-f9fdcc94551d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032862 Aug 19 15:35:23.831161 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 538/1066] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:35:24.608077 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9cf38188-4af5-4ef4-ae0f-6f598b42c4a7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:24.608705 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9cf38188-4af5-4ef4-ae0f-6f598b42c4a7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] [instance: 696874ca-88e5-4a6f-b3e6-21446e03bd78] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:24.615026 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cf38188-4af5-4ef4-ae0f-6f598b42c4a7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:24.615498 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cf38188-4af5-4ef4-ae0f-6f598b42c4a7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:24.615925 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cf38188-4af5-4ef4-ae0f-6f598b42c4a7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:24.616628 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cf38188-4af5-4ef4-ae0f-6f598b42c4a7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:24.617070 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cf38188-4af5-4ef4-ae0f-6f598b42c4a7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:24.617485 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cf38188-4af5-4ef4-ae0f-6f598b42c4a7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:24.745499 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9cf38188-4af5-4ef4-ae0f-6f598b42c4a7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f1d4cb0e89482f916d6ee9bfe9bcb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2558a7c80abd410bafa20a3aadc0e74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:35:24.753193 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9cf38188-4af5-4ef4-ae0f-6f598b42c4a7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] 10.222.0.75 "GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78" status: 200 len: 1315 microversion: 2.1 time: 0.149589 Aug 19 15:35:24.753758 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 529/1067] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:24 2022] GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:35:25.775103 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-da85c19b-353b-4520-b08a-92078ea8ae51 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:25.775793 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-da85c19b-353b-4520-b08a-92078ea8ae51 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] [instance: 696874ca-88e5-4a6f-b3e6-21446e03bd78] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:25.782022 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da85c19b-353b-4520-b08a-92078ea8ae51 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:25.782498 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da85c19b-353b-4520-b08a-92078ea8ae51 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:25.782930 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da85c19b-353b-4520-b08a-92078ea8ae51 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:25.783662 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da85c19b-353b-4520-b08a-92078ea8ae51 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:25.784063 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da85c19b-353b-4520-b08a-92078ea8ae51 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:25.784512 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da85c19b-353b-4520-b08a-92078ea8ae51 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:25.918209 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-da85c19b-353b-4520-b08a-92078ea8ae51 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f1d4cb0e89482f916d6ee9bfe9bcb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2558a7c80abd410bafa20a3aadc0e74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:35:25.925824 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-da85c19b-353b-4520-b08a-92078ea8ae51 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] 10.222.0.75 "GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78" status: 200 len: 1315 microversion: 2.1 time: 0.155486 Aug 19 15:35:25.926379 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 539/1068] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:25 2022] GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:35:26.947458 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-24b799ba-10b4-4f04-a4d0-3e3854a5ab48 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:26.948069 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-24b799ba-10b4-4f04-a4d0-3e3854a5ab48 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] [instance: 696874ca-88e5-4a6f-b3e6-21446e03bd78] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:26.955268 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24b799ba-10b4-4f04-a4d0-3e3854a5ab48 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:26.955752 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24b799ba-10b4-4f04-a4d0-3e3854a5ab48 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:26.956188 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24b799ba-10b4-4f04-a4d0-3e3854a5ab48 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:26.956902 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24b799ba-10b4-4f04-a4d0-3e3854a5ab48 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:26.957358 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24b799ba-10b4-4f04-a4d0-3e3854a5ab48 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:26.957784 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24b799ba-10b4-4f04-a4d0-3e3854a5ab48 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:27.088664 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-24b799ba-10b4-4f04-a4d0-3e3854a5ab48 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f1d4cb0e89482f916d6ee9bfe9bcb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2558a7c80abd410bafa20a3aadc0e74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:35:27.097306 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-24b799ba-10b4-4f04-a4d0-3e3854a5ab48 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] 10.222.0.75 "GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78" status: 200 len: 1315 microversion: 2.1 time: 0.153723 Aug 19 15:35:27.097885 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 530/1069] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:26 2022] GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:35:28.117094 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7932bf83-a255-4773-8436-5f59039f4f53 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:28.117707 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7932bf83-a255-4773-8436-5f59039f4f53 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] [instance: 696874ca-88e5-4a6f-b3e6-21446e03bd78] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:28.124310 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7932bf83-a255-4773-8436-5f59039f4f53 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:28.124834 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7932bf83-a255-4773-8436-5f59039f4f53 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:28.125269 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7932bf83-a255-4773-8436-5f59039f4f53 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:28.125971 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7932bf83-a255-4773-8436-5f59039f4f53 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:28.126427 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7932bf83-a255-4773-8436-5f59039f4f53 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:28.126854 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7932bf83-a255-4773-8436-5f59039f4f53 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:28.189745 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-62799ee4-99bd-40b9-87aa-195fcdb19f48 req-6ff3e426-54a3-4c19-9fc6-0a98b82c21e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696874ca-88e5-4a6f-b3e6-21446e03bd78", "name": "network-vif-plugged", "status": "completed", "tag": "b5f1aaf1-2ebf-40c5-9140-38fd09fed179"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:35:28.200955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-62799ee4-99bd-40b9-87aa-195fcdb19f48 req-6ff3e426-54a3-4c19-9fc6-0a98b82c21e4 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:28.201442 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-62799ee4-99bd-40b9-87aa-195fcdb19f48 req-6ff3e426-54a3-4c19-9fc6-0a98b82c21e4 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:28.201862 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-62799ee4-99bd-40b9-87aa-195fcdb19f48 req-6ff3e426-54a3-4c19-9fc6-0a98b82c21e4 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:28.214026 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-62799ee4-99bd-40b9-87aa-195fcdb19f48 req-6ff3e426-54a3-4c19-9fc6-0a98b82c21e4 service nova] Creating event network-vif-plugged:b5f1aaf1-2ebf-40c5-9140-38fd09fed179 for instance 696874ca-88e5-4a6f-b3e6-21446e03bd78 on hv-cinder-83538 Aug 19 15:35:28.219875 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-62799ee4-99bd-40b9-87aa-195fcdb19f48 req-6ff3e426-54a3-4c19-9fc6-0a98b82c21e4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033991 Aug 19 15:35:28.220698 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 531/1070] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 15:35:28.268966 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7932bf83-a255-4773-8436-5f59039f4f53 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f1d4cb0e89482f916d6ee9bfe9bcb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2558a7c80abd410bafa20a3aadc0e74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:35:28.276927 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7932bf83-a255-4773-8436-5f59039f4f53 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] 10.222.0.75 "GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78" status: 200 len: 1315 microversion: 2.1 time: 0.163775 Aug 19 15:35:28.277856 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 540/1071] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:28 2022] GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:35:29.299617 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7bc9b817-d2d5-4250-8139-93ff510b7a5f tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:29.300303 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7bc9b817-d2d5-4250-8139-93ff510b7a5f tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] [instance: 696874ca-88e5-4a6f-b3e6-21446e03bd78] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:29.307124 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bc9b817-d2d5-4250-8139-93ff510b7a5f tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:29.307597 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bc9b817-d2d5-4250-8139-93ff510b7a5f tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:29.308018 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bc9b817-d2d5-4250-8139-93ff510b7a5f tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:29.308720 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bc9b817-d2d5-4250-8139-93ff510b7a5f tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:29.309184 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bc9b817-d2d5-4250-8139-93ff510b7a5f tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:29.309604 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bc9b817-d2d5-4250-8139-93ff510b7a5f tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:29.448507 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7bc9b817-d2d5-4250-8139-93ff510b7a5f tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f1d4cb0e89482f916d6ee9bfe9bcb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2558a7c80abd410bafa20a3aadc0e74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:35:29.456562 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7bc9b817-d2d5-4250-8139-93ff510b7a5f tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] 10.222.0.75 "GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78" status: 200 len: 1315 microversion: 2.1 time: 0.161100 Aug 19 15:35:29.457134 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 532/1072] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:29 2022] GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:35:30.195273 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3ed76704-eadf-4fde-b55f-137b287bc438 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:30.195766 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3ed76704-eadf-4fde-b55f-137b287bc438 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:30.197645 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-1ff8b755-3e5b-4601-adf9-106c39951bf6 req-50fb752b-7bd6-4aba-97e6-111b8878f3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "446054b4-8b4f-45ec-9e9b-4a552af02065", "tag": "202d895f-8706-4b55-b8a7-80568bae22d1"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:35:30.203085 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ed76704-eadf-4fde-b55f-137b287bc438 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:30.203576 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ed76704-eadf-4fde-b55f-137b287bc438 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:30.204009 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ed76704-eadf-4fde-b55f-137b287bc438 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:30.205617 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ed76704-eadf-4fde-b55f-137b287bc438 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:30.206078 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ed76704-eadf-4fde-b55f-137b287bc438 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:30.206519 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ed76704-eadf-4fde-b55f-137b287bc438 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:30.208438 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1ff8b755-3e5b-4601-adf9-106c39951bf6 req-50fb752b-7bd6-4aba-97e6-111b8878f3a8 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:30.208993 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1ff8b755-3e5b-4601-adf9-106c39951bf6 req-50fb752b-7bd6-4aba-97e6-111b8878f3a8 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:30.209489 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1ff8b755-3e5b-4601-adf9-106c39951bf6 req-50fb752b-7bd6-4aba-97e6-111b8878f3a8 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:30.221294 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-1ff8b755-3e5b-4601-adf9-106c39951bf6 req-50fb752b-7bd6-4aba-97e6-111b8878f3a8 service nova] Creating event network-changed:202d895f-8706-4b55-b8a7-80568bae22d1 for instance 446054b4-8b4f-45ec-9e9b-4a552af02065 on hv-cinder-83538 Aug 19 15:35:30.227004 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-1ff8b755-3e5b-4601-adf9-106c39951bf6 req-50fb752b-7bd6-4aba-97e6-111b8878f3a8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033021 Aug 19 15:35:30.227935 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 533/1073] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:35:30.233569 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3ed76704-eadf-4fde-b55f-137b287bc438 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:35:30.320682 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3ed76704-eadf-4fde-b55f-137b287bc438 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "DELETE /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 204 len: 0 microversion: 2.1 time: 0.128949 Aug 19 15:35:30.321719 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 541/1074] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:35:30 2022] DELETE /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:35:30.332128 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-50e19a97-6463-4034-a81e-fa5a8d6f31ac tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:30.332885 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-50e19a97-6463-4034-a81e-fa5a8d6f31ac tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:30.339377 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50e19a97-6463-4034-a81e-fa5a8d6f31ac tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:30.339863 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50e19a97-6463-4034-a81e-fa5a8d6f31ac tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:30.340291 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50e19a97-6463-4034-a81e-fa5a8d6f31ac tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:30.341586 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50e19a97-6463-4034-a81e-fa5a8d6f31ac tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:30.342035 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50e19a97-6463-4034-a81e-fa5a8d6f31ac tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:30.342454 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50e19a97-6463-4034-a81e-fa5a8d6f31ac tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:30.478744 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-50e19a97-6463-4034-a81e-fa5a8d6f31ac tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:35:30.479173 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8347e004-de3a-4095-a3f7-3746e5dbb88d tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:30.479901 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8347e004-de3a-4095-a3f7-3746e5dbb88d tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] [instance: 696874ca-88e5-4a6f-b3e6-21446e03bd78] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:30.486707 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8347e004-de3a-4095-a3f7-3746e5dbb88d tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:30.487202 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8347e004-de3a-4095-a3f7-3746e5dbb88d tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:30.487414 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-50e19a97-6463-4034-a81e-fa5a8d6f31ac tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1567 microversion: 2.1 time: 0.159952 Aug 19 15:35:30.487669 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8347e004-de3a-4095-a3f7-3746e5dbb88d tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:30.488326 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8347e004-de3a-4095-a3f7-3746e5dbb88d tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:30.489363 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8347e004-de3a-4095-a3f7-3746e5dbb88d tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:30.489363 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8347e004-de3a-4095-a3f7-3746e5dbb88d tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:30.500584 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 534/1075] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:30 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:35:30.620443 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8347e004-de3a-4095-a3f7-3746e5dbb88d tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f1d4cb0e89482f916d6ee9bfe9bcb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2558a7c80abd410bafa20a3aadc0e74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:35:30.629042 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8347e004-de3a-4095-a3f7-3746e5dbb88d tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] 10.222.0.75 "GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78" status: 200 len: 1465 microversion: 2.1 time: 0.154753 Aug 19 15:35:30.629618 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 542/1076] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:30 2022] GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78 => generated 1465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:35:30.673865 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-df900216-b3d2-4bf2-bce7-370e27270ae7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:30.674940 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-df900216-b3d2-4bf2-bce7-370e27270ae7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] [instance: 696874ca-88e5-4a6f-b3e6-21446e03bd78] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:30.680938 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df900216-b3d2-4bf2-bce7-370e27270ae7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:30.681414 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df900216-b3d2-4bf2-bce7-370e27270ae7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:30.681836 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df900216-b3d2-4bf2-bce7-370e27270ae7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:30.682522 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df900216-b3d2-4bf2-bce7-370e27270ae7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:30.682989 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df900216-b3d2-4bf2-bce7-370e27270ae7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:30.683405 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df900216-b3d2-4bf2-bce7-370e27270ae7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:30.712559 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-df900216-b3d2-4bf2-bce7-370e27270ae7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] [instance: 696874ca-88e5-4a6f-b3e6-21446e03bd78] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 15:35:30.794760 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-df900216-b3d2-4bf2-bce7-370e27270ae7 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] 10.222.0.75 "DELETE /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78" status: 204 len: 0 microversion: 2.1 time: 0.123857 Aug 19 15:35:30.795438 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 535/1077] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Aug 19 15:35:30 2022] DELETE /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 15:35:30.803427 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7a45aa21-319c-4789-a6b8-aff2168d85b6 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:30.804031 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7a45aa21-319c-4789-a6b8-aff2168d85b6 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] [instance: 696874ca-88e5-4a6f-b3e6-21446e03bd78] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:30.811350 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a45aa21-319c-4789-a6b8-aff2168d85b6 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:30.811835 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a45aa21-319c-4789-a6b8-aff2168d85b6 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:30.812248 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a45aa21-319c-4789-a6b8-aff2168d85b6 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:30.812958 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a45aa21-319c-4789-a6b8-aff2168d85b6 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:30.813412 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a45aa21-319c-4789-a6b8-aff2168d85b6 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:30.813829 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a45aa21-319c-4789-a6b8-aff2168d85b6 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:30.951348 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7a45aa21-319c-4789-a6b8-aff2168d85b6 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f1d4cb0e89482f916d6ee9bfe9bcb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2558a7c80abd410bafa20a3aadc0e74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:35:30.959222 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7a45aa21-319c-4789-a6b8-aff2168d85b6 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] 10.222.0.75 "GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78" status: 200 len: 1471 microversion: 2.1 time: 0.159574 Aug 19 15:35:30.959790 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 543/1078] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:30 2022] GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:35:31.510423 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fe742b9f-471e-4c13-834a-41c58fec0803 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:31.511141 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fe742b9f-471e-4c13-834a-41c58fec0803 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:31.513140 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:35:31.519097 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe742b9f-471e-4c13-834a-41c58fec0803 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:31.519579 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe742b9f-471e-4c13-834a-41c58fec0803 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:31.520005 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe742b9f-471e-4c13-834a-41c58fec0803 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:31.520714 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe742b9f-471e-4c13-834a-41c58fec0803 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:31.521160 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe742b9f-471e-4c13-834a-41c58fec0803 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:31.521572 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe742b9f-471e-4c13-834a-41c58fec0803 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:31.665601 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fe742b9f-471e-4c13-834a-41c58fec0803 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:35:31.674577 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fe742b9f-471e-4c13-834a-41c58fec0803 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1567 microversion: 2.1 time: 0.168695 Aug 19 15:35:31.675438 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 536/1079] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:31 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:35:31.980499 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6cccea7f-617f-4d7c-8bb4-4fe261e579e2 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:31.981101 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6cccea7f-617f-4d7c-8bb4-4fe261e579e2 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] [instance: 696874ca-88e5-4a6f-b3e6-21446e03bd78] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:31.983266 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:35:31.983917 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=6 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:35:31.990748 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cccea7f-617f-4d7c-8bb4-4fe261e579e2 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:31.991230 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cccea7f-617f-4d7c-8bb4-4fe261e579e2 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:31.991661 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cccea7f-617f-4d7c-8bb4-4fe261e579e2 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:31.992351 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cccea7f-617f-4d7c-8bb4-4fe261e579e2 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:31.992918 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cccea7f-617f-4d7c-8bb4-4fe261e579e2 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:31.993347 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cccea7f-617f-4d7c-8bb4-4fe261e579e2 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:32.127718 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6cccea7f-617f-4d7c-8bb4-4fe261e579e2 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f1d4cb0e89482f916d6ee9bfe9bcb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2558a7c80abd410bafa20a3aadc0e74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:35:32.135361 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6cccea7f-617f-4d7c-8bb4-4fe261e579e2 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] 10.222.0.75 "GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78" status: 200 len: 1471 microversion: 2.1 time: 0.158772 Aug 19 15:35:32.135923 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 544/1080] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:31 2022] GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78 => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:35:32.696192 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-60e73cdc-ab90-4a57-829f-1c2b10e470b8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:32.696833 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-60e73cdc-ab90-4a57-829f-1c2b10e470b8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:32.703270 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60e73cdc-ab90-4a57-829f-1c2b10e470b8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:32.703750 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60e73cdc-ab90-4a57-829f-1c2b10e470b8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:32.704180 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60e73cdc-ab90-4a57-829f-1c2b10e470b8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:32.704891 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60e73cdc-ab90-4a57-829f-1c2b10e470b8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:32.705343 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60e73cdc-ab90-4a57-829f-1c2b10e470b8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:32.705765 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60e73cdc-ab90-4a57-829f-1c2b10e470b8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:32.839602 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-60e73cdc-ab90-4a57-829f-1c2b10e470b8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:35:32.847887 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-60e73cdc-ab90-4a57-829f-1c2b10e470b8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1567 microversion: 2.1 time: 0.155543 Aug 19 15:35:32.848468 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 537/1081] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:32 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:35:33.159819 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-be29a881-9817-4be0-919e-877b84a938ed tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:33.160548 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-be29a881-9817-4be0-919e-877b84a938ed tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] [instance: 696874ca-88e5-4a6f-b3e6-21446e03bd78] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:33.167679 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be29a881-9817-4be0-919e-877b84a938ed tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:33.168162 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be29a881-9817-4be0-919e-877b84a938ed tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:33.168619 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be29a881-9817-4be0-919e-877b84a938ed tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:33.170218 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be29a881-9817-4be0-919e-877b84a938ed tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:33.170821 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be29a881-9817-4be0-919e-877b84a938ed tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:33.171244 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be29a881-9817-4be0-919e-877b84a938ed tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:33.314462 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-be29a881-9817-4be0-919e-877b84a938ed tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f1d4cb0e89482f916d6ee9bfe9bcb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2558a7c80abd410bafa20a3aadc0e74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:35:33.322552 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-be29a881-9817-4be0-919e-877b84a938ed tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] 10.222.0.75 "GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78" status: 200 len: 1471 microversion: 2.1 time: 0.166543 Aug 19 15:35:33.323120 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 545/1082] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:33 2022] GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78 => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:35:33.869825 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d59ad2b7-5c9e-490d-b9c3-cbdab19604c2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:33.870432 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d59ad2b7-5c9e-490d-b9c3-cbdab19604c2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:33.876998 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d59ad2b7-5c9e-490d-b9c3-cbdab19604c2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:33.877477 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d59ad2b7-5c9e-490d-b9c3-cbdab19604c2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:33.878014 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d59ad2b7-5c9e-490d-b9c3-cbdab19604c2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:33.878567 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d59ad2b7-5c9e-490d-b9c3-cbdab19604c2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:33.879100 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d59ad2b7-5c9e-490d-b9c3-cbdab19604c2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:33.879712 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d59ad2b7-5c9e-490d-b9c3-cbdab19604c2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:34.015080 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d59ad2b7-5c9e-490d-b9c3-cbdab19604c2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:35:34.023289 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d59ad2b7-5c9e-490d-b9c3-cbdab19604c2 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1567 microversion: 2.1 time: 0.157415 Aug 19 15:35:34.023865 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 538/1083] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:33 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 15:35:34.226768 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-0867e539-f634-4dad-a481-b23b5204dae7 req-ba41a80c-8067-4af5-b2c7-0d141da0ef90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696874ca-88e5-4a6f-b3e6-21446e03bd78", "name": "network-vif-deleted", "tag": "b5f1aaf1-2ebf-40c5-9140-38fd09fed179"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:35:34.250085 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-0867e539-f634-4dad-a481-b23b5204dae7 req-ba41a80c-8067-4af5-b2c7-0d141da0ef90 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:34.250396 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-0867e539-f634-4dad-a481-b23b5204dae7 req-ba41a80c-8067-4af5-b2c7-0d141da0ef90 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:34.250828 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-0867e539-f634-4dad-a481-b23b5204dae7 req-ba41a80c-8067-4af5-b2c7-0d141da0ef90 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:34.278630 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-0867e539-f634-4dad-a481-b23b5204dae7 req-ba41a80c-8067-4af5-b2c7-0d141da0ef90 service nova] Creating event network-vif-deleted:b5f1aaf1-2ebf-40c5-9140-38fd09fed179 for instance 696874ca-88e5-4a6f-b3e6-21446e03bd78 on hv-cinder-83538 Aug 19 15:35:34.284798 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-0867e539-f634-4dad-a481-b23b5204dae7 req-ba41a80c-8067-4af5-b2c7-0d141da0ef90 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063032 Aug 19 15:35:34.286020 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 546/1084] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:35:34.344978 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-92b19deb-2353-41af-b1c2-65df35e20edf tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:34.345655 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-92b19deb-2353-41af-b1c2-65df35e20edf tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] [instance: 696874ca-88e5-4a6f-b3e6-21446e03bd78] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:34.353538 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92b19deb-2353-41af-b1c2-65df35e20edf tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:34.354018 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92b19deb-2353-41af-b1c2-65df35e20edf tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:34.354442 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92b19deb-2353-41af-b1c2-65df35e20edf tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:34.355126 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92b19deb-2353-41af-b1c2-65df35e20edf tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:34.355572 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92b19deb-2353-41af-b1c2-65df35e20edf tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:34.357254 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92b19deb-2353-41af-b1c2-65df35e20edf tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:34.392619 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92b19deb-2353-41af-b1c2-65df35e20edf tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:34.393092 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92b19deb-2353-41af-b1c2-65df35e20edf tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:34.393519 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92b19deb-2353-41af-b1c2-65df35e20edf tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:34.393955 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-92b19deb-2353-41af-b1c2-65df35e20edf tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lazy-loading 'fault' on Instance uuid 696874ca-88e5-4a6f-b3e6-21446e03bd78 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:35:34.441548 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-92b19deb-2353-41af-b1c2-65df35e20edf tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f1d4cb0e89482f916d6ee9bfe9bcb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2558a7c80abd410bafa20a3aadc0e74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:35:34.449769 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-92b19deb-2353-41af-b1c2-65df35e20edf tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] 10.222.0.75 "GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78" status: 200 len: 1305 microversion: 2.1 time: 0.110374 Aug 19 15:35:34.450374 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 539/1085] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:34 2022] GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:35:35.045297 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-603897f0-f460-4297-ac10-336109a9ea7b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:35.045991 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-603897f0-f460-4297-ac10-336109a9ea7b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:35.052182 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603897f0-f460-4297-ac10-336109a9ea7b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:35.052699 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603897f0-f460-4297-ac10-336109a9ea7b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:35.053141 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603897f0-f460-4297-ac10-336109a9ea7b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:35.053831 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603897f0-f460-4297-ac10-336109a9ea7b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:35.054540 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603897f0-f460-4297-ac10-336109a9ea7b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:35.054970 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603897f0-f460-4297-ac10-336109a9ea7b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:35.088071 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603897f0-f460-4297-ac10-336109a9ea7b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:35.088596 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603897f0-f460-4297-ac10-336109a9ea7b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:35.089034 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-603897f0-f460-4297-ac10-336109a9ea7b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:35.089485 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-603897f0-f460-4297-ac10-336109a9ea7b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lazy-loading 'fault' on Instance uuid 446054b4-8b4f-45ec-9e9b-4a552af02065 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 15:35:35.132281 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-603897f0-f460-4297-ac10-336109a9ea7b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7b30c3c094a8088c370a0d79ac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111b041a72b4481b3c8a286589e0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 15:35:35.141002 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-603897f0-f460-4297-ac10-336109a9ea7b tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 200 len: 1224 microversion: 2.1 time: 0.100546 Aug 19 15:35:35.141691 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 547/1086] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:35 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 15:35:35.471495 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2f61ba60-d404-4869-a292-75448d86f6b8 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:35.472133 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2f61ba60-d404-4869-a292-75448d86f6b8 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] [instance: 696874ca-88e5-4a6f-b3e6-21446e03bd78] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:35.478609 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f61ba60-d404-4869-a292-75448d86f6b8 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:35.479092 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f61ba60-d404-4869-a292-75448d86f6b8 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:35.479523 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f61ba60-d404-4869-a292-75448d86f6b8 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:35.480210 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f61ba60-d404-4869-a292-75448d86f6b8 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:35.480687 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f61ba60-d404-4869-a292-75448d86f6b8 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:35.481111 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f61ba60-d404-4869-a292-75448d86f6b8 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:35.495292 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-2f61ba60-d404-4869-a292-75448d86f6b8 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] HTTP exception thrown: Instance 696874ca-88e5-4a6f-b3e6-21446e03bd78 could not be found. Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2f61ba60-d404-4869-a292-75448d86f6b8 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Request method failure captured: Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78 HTTP/1.1 Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept: application/json Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Connection: close Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Length: 0 Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Content-Type: application/json Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Host: 10.222.0.75 Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.11 Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABi_623DrbGlxaCXzRdvgPxFPDposHpvl8RGEX2jmpU6_s-TrGT1P3GQf1UBGiKcMYA45XEwUD8uqxBsou9pSIFKaXCRuoiYimzd2ZMx-c9hbyuu40wEXUYFj7pTbzO033Yxv1GmZrU1nDzXY7mDU-lQVOFaieNkssPPG0lBaliJmHccvM Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Id: 2558a7c80abd410bafa20a3aadc0e74d Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesNegativeTest-2078505255 Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Role: member,reader Aug 19 15:35:35.496941 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Aug 19 15:35:35.499009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_2558a7c80abd410bafa20a3aadc0e74d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2558a7c80abd410bafa20a3aadc0e74d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2558a7c80abd410bafa20a3aadc0e74d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/2558a7c80abd410bafa20a3aadc0e74d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:35:35.499009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesNegativeTest-2078505255 Aug 19 15:35:35.499009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 2558a7c80abd410bafa20a3aadc0e74d Aug 19 15:35:35.499009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesNegativeTest-2078505255 Aug 19 15:35:35.499009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesNegativeTest-2078505255-project Aug 19 15:35:35.499009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Aug 19 15:35:35.499009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Aug 19 15:35:35.499009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Id: 72f1d4cb0e89482f916d6ee9bfe9bcb1 Aug 19 15:35:35.499009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesNegativeTest-2078505255-project Aug 19 15:35:35.499009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: method: > Aug 19 15:35:35.499009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: exception: Instance 696874ca-88e5-4a6f-b3e6-21446e03bd78 could not be found. Aug 19 15:35:35.499009 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: action_args: {'id': '696874ca-88e5-4a6f-b3e6-21446e03bd78'} Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 696874ca-88e5-4a6f-b3e6-21446e03bd78 could not be found. Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:35:35.500062 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:35:35.501716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:35:35.501716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:35:35.501716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:35:35.501716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:35:35.501716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:35:35.501716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:35:35.501716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:35:35.501716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 696874ca-88e5-4a6f-b3e6-21446e03bd78 could not be found. Aug 19 15:35:35.501716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:35:35.501716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:35:35.501716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:35:35.501716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:35:35.501716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:35:35.501716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:35:35.501716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:35:35.501716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:35:35.501716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 696874ca-88e5-4a6f-b3e6-21446e03bd78 could not be found. Aug 19 15:35:35.501716 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Aug 19 15:35:35.503174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2f61ba60-d404-4869-a292-75448d86f6b8 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] Returning 404 to user: Instance 696874ca-88e5-4a6f-b3e6-21446e03bd78 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:35:35.503174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2f61ba60-d404-4869-a292-75448d86f6b8 tempest-VolumesNegativeTest-2078505255 tempest-VolumesNegativeTest-2078505255-project] 10.222.0.75 "GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78" status: 404 len: 111 microversion: 2.1 time: 0.030747 Aug 19 15:35:35.503174 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 540/1087] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:35 2022] GET /compute/v2.1/servers/696874ca-88e5-4a6f-b3e6-21446e03bd78 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:35:36.163749 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0782140e-b357-40f2-aa36-e362236c1183 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:36.164628 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0782140e-b357-40f2-aa36-e362236c1183 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] [instance: 446054b4-8b4f-45ec-9e9b-4a552af02065] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 15:35:36.171091 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0782140e-b357-40f2-aa36-e362236c1183 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:36.171579 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0782140e-b357-40f2-aa36-e362236c1183 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:36.172019 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0782140e-b357-40f2-aa36-e362236c1183 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:36.172757 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0782140e-b357-40f2-aa36-e362236c1183 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:36.173213 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0782140e-b357-40f2-aa36-e362236c1183 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:36.173639 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0782140e-b357-40f2-aa36-e362236c1183 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:36.188555 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-0782140e-b357-40f2-aa36-e362236c1183 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] HTTP exception thrown: Instance 446054b4-8b4f-45ec-9e9b-4a552af02065 could not be found. Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0782140e-b357-40f2-aa36-e362236c1183 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Request method failure captured: Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 HTTP/1.1 Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept: application/json Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Connection: close Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Length: 0 Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Content-Type: application/json Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Host: 10.222.0.75 Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.11 Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABi_6y4sWYb1TfGbcitpFhdJe6w8av2IKT7JoicfciFJVE3EfKLJFDKigTXjkNDHf5Ib7ym4EakGz8oT3XZS0kCddNEQ_Vr0pLHn9i8QvawxvKHK9b3QH0TFqXjsJ7F-795D06aG2fQwkzxxkTdGF5hpHjOrDj1er3iurU7Z8lDWohqdlU Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Id: 7111b041a72b4481b3c8a286589e0a4e Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-TestShelveInstance-665903214 Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Role: member,reader Aug 19 15:35:36.190203 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Aug 19 15:35:36.191894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7111b041a72b4481b3c8a286589e0a4e", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7111b041a72b4481b3c8a286589e0a4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7111b041a72b4481b3c8a286589e0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7111b041a72b4481b3c8a286589e0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}] Aug 19 15:35:36.191894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-TestShelveInstance-665903214 Aug 19 15:35:36.191894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 7111b041a72b4481b3c8a286589e0a4e Aug 19 15:35:36.191894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-TestShelveInstance-665903214 Aug 19 15:35:36.191894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User: tempest-TestShelveInstance-665903214-project Aug 19 15:35:36.191894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Aug 19 15:35:36.191894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Aug 19 15:35:36.191894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Id: 55a7b30c3c094a8088c370a0d79ac98a Aug 19 15:35:36.191894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-TestShelveInstance-665903214-project Aug 19 15:35:36.191894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: method: > Aug 19 15:35:36.191894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: exception: Instance 446054b4-8b4f-45ec-9e9b-4a552af02065 could not be found. Aug 19 15:35:36.191894 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: action_args: {'id': '446054b4-8b4f-45ec-9e9b-4a552af02065'} Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 446054b4-8b4f-45ec-9e9b-4a552af02065 could not be found. Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 15:35:36.196838 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 15:35:36.198557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 15:35:36.198557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 15:35:36.198557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 15:35:36.198557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 15:35:36.198557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 15:35:36.198557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 15:35:36.198557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 15:35:36.198557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 446054b4-8b4f-45ec-9e9b-4a552af02065 could not be found. Aug 19 15:35:36.198557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:35:36.198557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 15:35:36.198557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:35:36.198557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 15:35:36.198557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 15:35:36.198557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 15:35:36.198557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 15:35:36.198557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 15:35:36.198557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 446054b4-8b4f-45ec-9e9b-4a552af02065 could not be found. Aug 19 15:35:36.198557 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Aug 19 15:35:36.199963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0782140e-b357-40f2-aa36-e362236c1183 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Returning 404 to user: Instance 446054b4-8b4f-45ec-9e9b-4a552af02065 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 15:35:36.199963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0782140e-b357-40f2-aa36-e362236c1183 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065" status: 404 len: 111 microversion: 2.1 time: 0.032033 Aug 19 15:35:36.199963 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 548/1088] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Aug 19 15:35:36 2022] GET /compute/v2.1/servers/446054b4-8b4f-45ec-9e9b-4a552af02065 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 15:35:36.308156 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-4f870356-091e-4683-9a11-25546285b336 req-f13632b6-a82d-4e6f-9e5f-95f248997517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446054b4-8b4f-45ec-9e9b-4a552af02065", "name": "network-vif-deleted", "tag": "202d895f-8706-4b55-b8a7-80568bae22d1"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 15:35:36.318512 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4f870356-091e-4683-9a11-25546285b336 req-f13632b6-a82d-4e6f-9e5f-95f248997517 service nova] Acquiring lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 15:35:36.318991 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4f870356-091e-4683-9a11-25546285b336 req-f13632b6-a82d-4e6f-9e5f-95f248997517 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 15:35:36.319415 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4f870356-091e-4683-9a11-25546285b336 req-f13632b6-a82d-4e6f-9e5f-95f248997517 service nova] Lock "a03065dc-9ed1-41c0-91a1-8e1d53fd2fc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 15:35:36.336105 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-4f870356-091e-4683-9a11-25546285b336 req-f13632b6-a82d-4e6f-9e5f-95f248997517 service nova] Creating event network-vif-deleted:202d895f-8706-4b55-b8a7-80568bae22d1 for instance 446054b4-8b4f-45ec-9e9b-4a552af02065 on hv-cinder-83538 Aug 19 15:35:36.342410 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-4f870356-091e-4683-9a11-25546285b336 req-f13632b6-a82d-4e6f-9e5f-95f248997517 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037921 Aug 19 15:35:36.343159 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 541/1089] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Aug 19 15:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 15:35:36.382504 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-014da30a-d7bb-4523-8d7c-344b90ebf8d8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] Calling method '.version_select at 0x7fb533401790>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 15:35:36.417270 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-014da30a-d7bb-4523-8d7c-344b90ebf8d8 tempest-TestShelveInstance-665903214 tempest-TestShelveInstance-665903214-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-936999056" status: 202 len: 0 microversion: 2.1 time: 0.039477 Aug 19 15:35:36.417918 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 549/1090] 10.222.0.75 () {58 vars in 1251 bytes} [Fri Aug 19 15:35:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-936999056 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 15:36:41.141021 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 15:36:41.141543 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Fri Aug 19 15:36:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 15:38:19.624752 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 15:38:19.625397 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Fri Aug 19 15:38:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 15:38:38.011171 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 15:38:38.011763 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Fri Aug 19 15:38:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 15:38:45.210680 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 15:38:45.211301 dv-cinder-835384-20-iscsi devstack@n-api.service[120638]: Fri Aug 19 15:38:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 15:39:56.402326 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 15:39:56.402912 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Fri Aug 19 15:39:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 15:40:01.149416 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 15:40:01.150106 dv-cinder-835384-20-iscsi devstack@n-api.service[120637]: Fri Aug 19 15:40:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!